Apr 30 10:45:06 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:45:06 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:45:06 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:45:06 devstack cinder-volume[75741]: INFO dbcounter [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Registered counter for database cinder Apr 30 10:45:06 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writer thread running {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.rpc [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.rpc [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Determined volume DB was empty at startup. Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG cinder.volume.manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 30 10:45:07 devstack cinder-volume[75741]: WARNING stevedore.named [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 10:45:07 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:45:07 devstack cinder-volume[75741]: WARNING cinder.keymgr.conf_key_mgr [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG cinder.volume.drivers.lvm [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.375s {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.rpc [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.rpc [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 30 10:45:07 devstack cinder-volume[75741]: WARNING stevedore.named [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 10:45:07 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:45:07 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:45:07 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Starting 1 workers Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Started child 75911 {{(pid=75741) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Full set of CONF: {{(pid=75741) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Configuration options gathered from: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] ================================================================================ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 10:45:07 devstack cinder-volume[75911]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] allow_availability_zone_fallback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] allow_compression_on_image_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] allowed_direct_url_schemes = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] api_rate_limit = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] auth_strategy = keystone {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] az_cache_duration = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_stats_polling_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backup_api_class = cinder.backup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backup_name_template = backup-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backup_use_same_host = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_internal_tenant_project_id = 7e62ada7b15c4a7ea7b3f7dc8ca04918 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_internal_tenant_user_id = cf027d80405a4e1cb62ad0931cdef78f {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cloned_volume_same_az = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cluster = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] compression_format = gzip {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] config_dir = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] config_source = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] control_exchange = openstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] debug = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] default_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] default_group_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] default_volume_type = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] enable_force_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] enable_new_services = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_api_insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_api_ssl_compression = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_ca_certificates_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_num_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance_request_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] graceful_shutdown_timeout = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] group_api_class = cinder.group.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] host = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_compress_on_upload = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_conversion_address_space_limit = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_conversion_cpu_limit = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_conversion_disable = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] init_host_max_objects_retrieval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] instance_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iser_ip_address = 192.168.122.163 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_color = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_config_append = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_options = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_rotate_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_rotate_interval_type = days {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] log_rotation_type = none {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] max_age = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] max_logfile_count = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] max_logfile_size_mb = 200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] message_reap_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] message_ttl = 2592000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] monkey_patch = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] monkey_patch_modules = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] my_ip = 192.168.122.163 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] no_snapshot_gb_quota = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_max_limit = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_ext_list = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_listen_port = 8776 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] osapi_volume_workers = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] per_volume_size_limit = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] periodic_fuzzy_delay = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] periodic_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] public_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] publish_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_backup_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_backups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_groups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_snapshots = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] quota_volumes = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] rate_limit_burst = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] rate_limit_except_level = CRITICAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] rate_limit_interval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] reinit_driver_count = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] report_interval = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] reservation_clean_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] reservation_expire = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] reserved_image_namespaces = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] rpc_response_timeout = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] run_external_periodic_tasks = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_down_time = 720 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] shell_completion = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] snapshot_name_template = snapshot-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] snapshot_same_host = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] state_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] storage_availability_zone = nova {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] syslog_log_facility = LOG_USER {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_ip_address = 192.168.122.163 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] until_refresh = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_default_quota_class = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_journal = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_json = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_stderr = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] use_syslog = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] verify_glance_signatures = enabled {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_api_class = cinder.volume.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_name_template = volume-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_service_inithost_offload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volume_usage_audit_period = month {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] zoning_mode = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.admin_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.admin_token = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.admin_user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:07 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_port = 35357 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_protocol = https {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_uri = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.auth_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.identity_uri = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.interface = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_password = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:07 devstack sudo[75915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 30 10:45:07 devstack sudo[75915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcache_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.service_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.backend = dogpile.cache.null {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.backend_argument = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.backend_expiration_time = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.config_prefix = cache.oslo {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.debug_cache_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.enable_retry_client = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.enable_socket_keepalive = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.enforce_fips_mode = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.expiration_time = 600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.proxies = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.redis_db = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.redis_server = localhost:6379 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.retry_delay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.socket_keepalive_count = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.socket_keepalive_idle = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.socket_keepalive_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.socket_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cache.username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] coordination.backend_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.asyncio_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.asyncio_slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.backend = sqlalchemy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.connection_debug = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.connection_parameters = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.connection_recycle_time = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.connection_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.db_inc_retry_interval = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.db_max_retries = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.db_max_retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.db_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.max_overflow = 50 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.max_pool_size = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.max_retries = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.pool_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.sqlite_synchronous = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.synchronous_reader = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] database.use_db_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.connection_string = messaging:// {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.es_doc_type = notification {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.es_scroll_size = 10000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.es_scroll_time = 2m {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.filter_error_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.hmac_keys = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.socket_timeout = 0.1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.trace_requests = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler.trace_sqlalchemy = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler_jaeger.process_tags = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] profiler_otlp.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.enforce_new_defaults = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: WARNING oslo_config.cfg [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.enforce_scope = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.policy_default_rule = default {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] privsep_osbrick.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] cinder_sys_admin.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.send_service_user_token = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] glance.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.extra_capabilities = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.lvm_share_target = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_reports.file_event_handler = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_reports.log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.chap_username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iser_helper = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iser_port = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.storage_protocol = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] lvmdriver-1.volumes_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_notifications.driver = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] key_manager.fixed_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.barbican_api_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.barbican_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.barbican_endpoint_type = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.barbican_region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.number_of_retries = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.retry_delay = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.send_service_user_token = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.verify_ssl = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican.verify_ssl_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.auth_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] barbican_service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.approle_role_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.approle_secret_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.kv_mountpoint = secret {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.kv_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.kv_version = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.root_token_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:45:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 10:45:08 devstack sudo[75915]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:08 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.871s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:08 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:08 devstack sudo[76061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:08 devstack sudo[76061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:09 devstack sudo[76061]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:09 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.665s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:09 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:45:09 devstack cinder-volume[75911]: INFO cinder.brick.local_dev.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 30 10:45:09 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:09 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:09 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:09 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:09 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:10 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:10 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:10 devstack cinder-volume[75911]: DEBUG cinder.brick.local_dev.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75911) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 30 10:45:10 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:10 devstack sudo[76480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:10 devstack sudo[76480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:11 devstack sudo[76480]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:11 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.169s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:11 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:11 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:11 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:11 devstack sudo[76669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:11 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:12 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:12 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 30 10:45:12 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:12 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.765s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:12 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:12 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:13 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:13 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:13 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:13 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:13 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:14 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:14 devstack sudo[76707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:14 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:14 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:14 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:14 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:14 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:15 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:15 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:15 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:15 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:15 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:15 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:15 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:16 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:16 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.873s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:16 devstack cinder-volume[75911]: INFO cinder.volume.drivers.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 30 10:45:16 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:16 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:16 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:16 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:16 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:17 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:17 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.820s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:17 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 10:45:17 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:17 devstack sudo[76843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:17 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:17 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:45:17 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:17 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:17 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:17 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:17 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:18 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:18 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:18 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:18 devstack sudo[76989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:18 devstack sudo[76989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:19 devstack sudo[76989]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:19 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:19 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:19 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:19 devstack cinder-volume[75911]: INFO cinder.volume.driver [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Driver hasn't implemented _init_vendor_properties() Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG cinder.volume.driver [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75911) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG oslo_db.sqlalchemy.engines [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75911) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writer thread running {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG cinder.db.sqlalchemy.api [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Building query based on filter {{(pid=75911) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG cinder.image.image_utils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75911) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 10:45:19 devstack cinder-volume[75911]: INFO cinder.keymgr.migration [None req-29e39e95-d89e-43b8-ac7b-99d04b3cd05f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 10:45:19 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:19 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:19 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:20 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:20 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:20 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:20 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:20 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:20 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:20 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:20 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:20 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:20 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:21 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:21 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:21 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:21 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:21 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:22 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:45:22 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Driver initialization completed successfully. Apr 30 10:45:22 devstack cinder-volume[75911]: INFO cinder.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Initiating service 2 cleanup Apr 30 10:45:22 devstack cinder-volume[75911]: INFO cinder.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Service 2 cleanup completed. Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG cinder.service [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Creating RPC server for service cinder-volume {{(pid=75911) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG cinder.service [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75911) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 10:45:22 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:22 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:45:22 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:22 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:22 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:22 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:22 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:23 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:23 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:23 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:45:23 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:24 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:24 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:24 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:45:24 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:45:24 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:45:24 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Apr 30 10:45:24 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:45:24 devstack cinder-volume[75911]: INFO cinder.volume.manager [None req-52e058ee-6a11-4f86-bfa1-4f68fea3f56e None None] Driver post RPC initialization completed successfully. Apr 30 10:45:34 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:45:34 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:46:47 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:46:47 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 10:46:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:46:47 devstack sudo[81787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:46:47 devstack sudo[81787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:46:48 devstack sudo[81787]: pam_unix(sudo:session): session closed for user root Apr 30 10:46:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:46:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:46:48 devstack sudo[81791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:46:48 devstack sudo[81791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:46:49 devstack sudo[81791]: pam_unix(sudo:session): session closed for user root Apr 30 10:46:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:46:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:46:49 devstack sudo[81794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:46:49 devstack sudo[81794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:46:49 devstack sudo[81794]: pam_unix(sudo:session): session closed for user root Apr 30 10:46:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:46:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:46:49 devstack sudo[81797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:46:49 devstack sudo[81797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:46:50 devstack sudo[81797]: pam_unix(sudo:session): session closed for user root Apr 30 10:46:50 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:46:50 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:47:34 devstack cinder-volume[75911]: DEBUG dbcounter [-] [75911] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:47:47 devstack cinder-volume[75911]: DEBUG oslo_service.periodic_task [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75911) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:47:47 devstack cinder-volume[75911]: DEBUG cinder.volume.drivers.lvm [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Updating volume stats {{(pid=75911) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 10:47:47 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:47:47 devstack sudo[82270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 10:47:47 devstack sudo[82270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:47:48 devstack sudo[82270]: pam_unix(sudo:session): session closed for user root Apr 30 10:47:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:47:48 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:47:48 devstack sudo[82275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:47:48 devstack sudo[82275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:47:49 devstack sudo[82275]: pam_unix(sudo:session): session closed for user root Apr 30 10:47:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:47:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:47:49 devstack sudo[82290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 10:47:49 devstack sudo[82290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:47:49 devstack sudo[82290]: pam_unix(sudo:session): session closed for user root Apr 30 10:47:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:47:49 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:47:49 devstack sudo[82297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 10:47:49 devstack sudo[82297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:47:50 devstack sudo[82297]: pam_unix(sudo:session): session closed for user root Apr 30 10:47:50 devstack cinder-volume[75911]: DEBUG oslo_concurrency.processutils [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75911) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:47:50 devstack cinder-volume[75911]: DEBUG cinder.manager [None req-5299bbfb-54e5-4b54-a675-67b5607e0ee1 None None] Notifying Schedulers of capabilities ... {{(pid=75911) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:48:08 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Caught SIGTERM, stopping children Apr 30 10:48:08 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:08 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:08 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Stop services. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 30 10:48:08 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Killing children. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 30 10:48:08 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Waiting on 1 children to exit Apr 30 10:48:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Acquiring lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Acquired lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:12 devstack cinder-volume[75911]: DEBUG oslo_concurrency.lockutils [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Releasing lock "singleton_lock" {{(pid=75911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:12 devstack cinder-volume[75911]: WARNING amqp [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 10:48:12 devstack cinder-volume[75911]: WARNING amqp [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 10:48:12 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-43bdc21f-8482-4703-b42d-e904f87be9d4 None None] Child 75911 exited with status 0 Apr 30 10:48:14 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:14 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:14 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:15 devstack cinder-volume[83569]: INFO dbcounter [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Registered counter for database cinder Apr 30 10:48:15 devstack cinder-volume[83569]: DEBUG oslo_db.sqlalchemy.engines [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83569) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:15 devstack cinder-volume[83569]: DEBUG dbcounter [-] [83569] Writer thread running {{(pid=83569) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:48:15 devstack cinder-volume[83569]: INFO cinder.rpc [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 10:48:15 devstack cinder-volume[83569]: INFO cinder.rpc [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 10:48:15 devstack cinder-volume[83569]: DEBUG oslo_db.sqlalchemy.engines [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83569) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:15 devstack cinder-volume[83569]: INFO cinder.volume.manager [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Determined volume DB was empty at startup. Apr 30 10:48:15 devstack cinder-volume[83569]: DEBUG cinder.volume.manager [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83569) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 10:48:15 devstack cinder-volume[83569]: INFO cinder.volume.manager [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 30 10:48:15 devstack cinder-volume[83569]: WARNING stevedore.named [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 10:48:15 devstack cinder-volume[83569]: WARNING castellan.key_manager [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:48:15 devstack cinder-volume[83569]: WARNING cinder.keymgr.conf_key_mgr [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:48:16 devstack cinder-volume[83569]: INFO cinder.volume.manager [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_db.sqlalchemy.engines [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83569) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:16 devstack cinder-volume[83569]: INFO oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Starting 1 workers Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Started child 83862 {{(pid=83569) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Full set of CONF: {{(pid=83569) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] ******************************************************************************** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Configuration options gathered from: {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] ================================================================================ {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] allow_availability_zone_fallback = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] allow_compression_on_image_upload = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] allowed_direct_url_schemes = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] api_rate_limit = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] auth_strategy = keystone {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_availability_zone = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_host = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_stats_polling_interval = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backup_api_class = cinder.backup.api.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backup_name_template = backup-%s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backup_use_same_host = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backup_use_temp_snapshot = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] chap_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] chap_username = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_internal_tenant_project_id = 7e62ada7b15c4a7ea7b3f7dc8ca04918 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_internal_tenant_user_id = cf027d80405a4e1cb62ad0931cdef78f {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cluster = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] compression_format = gzip {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83862]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] compute_api_class = cinder.compute.nova.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] config_dir = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] config_source = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] control_exchange = openstack {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] debug = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] default_availability_zone = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] default_group_type = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] default_volume_type = QuobyteHD {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] disk_geometry = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_client_cert = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_client_cert_key = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_data_namespace = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_ssl_cert_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_ssl_cert_verify = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] driver_use_ssl = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] enable_new_services = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] enable_unsupported_driver = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] enabled_backends = ['QuobyteHD'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] enforce_multipath_for_image_xfer = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] filter_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_api_insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_api_ssl_compression = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_ca_certificates_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_catalog_info = image:glance:publicURL {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_num_retries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance_request_timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] goodness_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] graceful_shutdown_timeout = 5 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] group_api_class = cinder.group.api.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] host = devstack {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_compress_on_upload = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_conversion_address_space_limit = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_conversion_cpu_limit = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_conversion_disable = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_upload_use_cinder_backend = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_upload_use_internal_tenant = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_volume_cache_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_volume_cache_max_count = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] image_volume_cache_max_size_gb = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] init_host_max_objects_retrieval = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] instance_format = [instance: %(uuid)s] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iscsi_target_flags = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iscsi_write_cache = on {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iser_helper = tgtadm {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iser_ip_address = 192.168.122.163 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iser_port = 3260 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_color = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_config_append = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_dir = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_options = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_rotate_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_rotate_interval_type = days {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] log_rotation_type = none {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] max_age = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] max_logfile_count = 30 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] max_logfile_size_mb = 200 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] max_over_subscription_ratio = 20.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] message_reap_interval = 86400 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] message_ttl = 2592000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] migration_create_volume_timeout_secs = 300 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] monkey_patch = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] monkey_patch_modules = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] my_ip = 192.168.122.163 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] no_snapshot_gb_quota = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] num_iser_scan_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] num_shell_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] num_volume_device_scan_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] nvmeof_conn_info_version = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] nvmet_ns_id = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] nvmet_port_id = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_max_limit = 1000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_ext_list = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_listen_port = 8776 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_use_ssl = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] osapi_volume_workers = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] per_volume_size_limit = -1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] periodic_fuzzy_delay = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] periodic_interval = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83862]: INFO cinder.volume.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Starting volume driver QuobyteDriver (1.1.14) Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.remotefs [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83862) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] public_endpoint = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] publish_errors = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_backup_gigabytes = 1000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_backups = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_gigabytes = 1000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_groups = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_snapshots = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] quota_volumes = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] rate_limit_burst = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] rate_limit_except_level = CRITICAL {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] rate_limit_interval = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] reinit_driver_count = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] replication_device = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] report_discard_supported = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] report_interval = 120 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] reservation_clean_interval = 86400 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] reservation_expire = 86400 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] reserved_image_namespaces = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] reserved_percentage = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] rpc_response_timeout = 120 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] run_external_periodic_tasks = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] scst_target_driver = iscsi {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] scst_target_iqn_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_down_time = 720 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] shell_completion = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] snapshot_name_template = snapshot-%s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] split_loggers = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] state_path = /opt/stack/data/cinder {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] storage_availability_zone = nova {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] storage_protocol = iSCSI {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] syslog_log_facility = LOG_USER {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_helper = lioadm {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_ip_address = 192.168.122.163 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_port = 3260 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_protocol = iscsi {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] target_secondary_ip_addresses = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] trace_flags = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] transport_url = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] until_refresh = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_chap_auth = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_default_quota_class = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_journal = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_json = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_multipath_for_image_xfer = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_stderr = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] use_syslog = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] verify_glance_signatures = enabled {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_api_class = cinder.volume.api.API {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_backend_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_clear = zero {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_clear_ionice = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_clear_size = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_copy_bps_limit = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_dd_blocksize = 1M {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_name_template = volume-%s {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_service_inithost_offload = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volume_usage_audit_period = month {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] zoning_mode = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_concurrency.disable_process_locking = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.admin_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.admin_token = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.admin_user = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_port = 35357 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_protocol = https {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_section = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_type = password {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_uri = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.auth_version = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.cache = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.identity_uri = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.include_service_catalog = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.interface = public {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_password = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcache_username = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.region_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.service_type = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.backend = dogpile.cache.null {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.backend_argument = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.backend_expiration_time = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.config_prefix = cache.oslo {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.debug_cache_backend = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.enable_retry_client = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.enable_socket_keepalive = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.enforce_fips_mode = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.expiration_time = 600 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.hashclient_retry_attempts = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_dead_retry = 300 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_pool_maxsize = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_sasl_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.proxies = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.redis_db = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.redis_server = localhost:6379 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.retry_attempts = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.retry_delay = 0.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.socket_keepalive_count = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.socket_keepalive_idle = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.socket_keepalive_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.socket_timeout = 1.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.tls_allowed_ciphers = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.tls_cafile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.tls_certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.tls_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.tls_keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cache.username = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] coordination.backend_url = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.asyncio_connection = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.asyncio_slave_connection = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.backend = sqlalchemy {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.connection = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.connection_debug = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.connection_parameters = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.connection_recycle_time = 3600 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.connection_trace = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.db_inc_retry_interval = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.db_max_retries = 20 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.db_max_retry_interval = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.db_retry_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.max_overflow = 50 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.max_pool_size = 5 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.max_retries = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.mysql_wsrep_sync_wait = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.pool_timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.retry_interval = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.slave_connection = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.sqlite_synchronous = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.synchronous_reader = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] database.use_db_reconnect = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.connection_string = messaging:// {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.es_doc_type = notification {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.es_scroll_size = 10000 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.es_scroll_time = 2m {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.filter_error_trace = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.hmac_keys = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.sentinel_service_name = mymaster {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.socket_timeout = 0.1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.trace_requests = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler.trace_sqlalchemy = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83862) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 30 10:48:16 devstack cinder-volume[83862]: WARNING cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 30 10:48:16 devstack cinder-volume[83862]: WARNING cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler_jaeger.process_tags = {} {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler_jaeger.service_name_prefix = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] profiler_otlp.service_name_prefix = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.enforce_new_defaults = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: WARNING oslo_config.cfg [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.enforce_scope = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.policy_default_rule = default {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.policy_file = policy.yaml {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.group = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.helper_command = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Running cmd (subprocess): mount.quobyte {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] privsep_osbrick.user = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.group = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.helper_command = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] cinder_sys_admin.user = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.auth_section = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.auth_type = password {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.cafile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.collect_timing = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.send_service_user_token = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.split_loggers = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] service_user.timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.auth_section = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.auth_type = password {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.collect_timing = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.region_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.split_loggers = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] glance.timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.backend_availability_zone = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.chap_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.chap_username = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.disk_geometry = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_client_cert = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_client_cert_key = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_data_namespace = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.driver_use_ssl = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.extra_capabilities = {} {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.filter_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.goodness_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iscsi_target_flags = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iscsi_write_cache = on {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iser_helper = tgtadm {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iser_port = 3260 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_host = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_login = admin {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_mount_options = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_private_key = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_share_path = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.num_shell_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.quobyte_volume_url = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.replication_device = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.report_discard_supported = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.reserved_percentage = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_helper = tgtadm {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_port = 3260 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_protocol = iscsi {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.trace_flags = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.unique_fqdn_network = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.use_chap_auth = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_backend_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_clear = zero {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_clear_ionice = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_clear_size = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_reports.file_event_handler = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_reports.log_dir = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.backend_availability_zone = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.backend_host = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.chap_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.chap_username = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.chiscsi_conf = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.disk_geometry = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_client_cert = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_data_namespace = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.driver_use_ssl = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.extra_capabilities = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.filter_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.goodness_function = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iser_helper = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iser_ip_address = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iser_port = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.iser_target_prefix = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_host = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_login = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_mount_options = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_password = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_private_key = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_share_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_ssh_port = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.num_shell_tries = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.nvmet_port_id = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.replication_device = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.report_discard_supported = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.reserved_percentage = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.scst_target_driver = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.storage_protocol = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_helper = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_ip_address = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_port = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_prefix = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_protocol = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.trace_flags = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.use_chap_auth = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_clear = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_clear_size = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] QuobyteHD.volumes_dir = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack quobyte-client[83863]: Reading configuration file: /etc/quobyte/client.cfg Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_notifications.driver = [] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_notifications.retry = -1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack quobyte-client[83863]: Invalid parameters found, error: missing mount point. Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] key_manager.fixed_key = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.barbican_api_version = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.barbican_endpoint = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.barbican_endpoint_type = public {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.barbican_region_name = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.cafile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack quobyte-client[83863]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.collect_timing = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.number_of_retries = 60 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.retry_delay = 1 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.send_service_user_token = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack quobyte-client[83863]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.split_loggers = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.verify_ssl = True {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican.verify_ssl_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.auth_section = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.auth_type = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.cafile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.certfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.collect_timing = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.insecure = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.keyfile = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.split_loggers = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] barbican_service_user.timeout = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.approle_role_id = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.approle_secret_id = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.kv_mountpoint = secret {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.kv_path = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.kv_version = 2 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.namespace = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.root_token_id = **** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.ssl_ca_crt_file = None {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.timeout = 60.0 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.use_ssl = False {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:16 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] ******************************************************************************** {{(pid=83569) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] CMD "mount.quobyte" returned: 1 in 0.189s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=83862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:16 devstack cinder-volume[83862]: INFO cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a ... Apr 30 10:48:16 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 -c /etc/quobyte/client-cinder.cfg {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:16 devstack sudo[83874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 -c /etc/quobyte/client-cinder.cfg Apr 30 10:48:16 devstack sudo[83874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:17 devstack sudo[83874]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:17 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.789s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:17 devstack cinder-volume[83862]: INFO cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a succeeded Apr 30 10:48:17 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=83862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:17 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.803s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:17 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:17 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:17 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:18 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.618s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.volume.driver [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Driver hasn't implemented _init_vendor_properties() Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.volume.driver [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7132949829102, 'free_capacity_gb': 1775.7132949829102, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83862) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_db.sqlalchemy.engines [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG dbcounter [-] [83862] Writer thread running {{(pid=83862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.db.sqlalchemy.api [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Building query based on filter {{(pid=83862) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.image.image_utils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83862) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.keymgr.migration [None req-a00a2a65-cb32-406c-9519-b92095493ae3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=83862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=83862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:18 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:18 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:18 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.628s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Notifying Schedulers of capabilities ... {{(pid=83862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.volume.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Driver initialization completed successfully. Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Initiating service 3 cleanup Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Service 3 cleanup completed. Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.service [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Creating RPC server for service cinder-volume {{(pid=83862) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.service [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83862) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 10:48:18 devstack cinder-volume[83862]: INFO cinder.volume.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=83862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=83862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:18 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:18 devstack sudo[84013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:18 devstack sudo[84013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:19 devstack sudo[84013]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:19 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.661s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:19 devstack cinder-volume[83862]: INFO cinder.volume.manager [None req-b6dd2fb2-1664-4513-9155-d04df001bb8d None None] Driver post RPC initialization completed successfully. Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=83862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG cinder.volume.drivers.quobyte [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=83862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:23 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:23 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:23 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG oslo_concurrency.processutils [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.562s {{(pid=83862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:23 devstack cinder-volume[83862]: DEBUG cinder.manager [None req-71edb64c-078d-48e4-9e05-d2339e412442 None None] Notifying Schedulers of capabilities ... {{(pid=83862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:48:23 devstack cinder-volume[83569]: INFO oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Caught SIGTERM, stopping children Apr 30 10:48:23 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Acquiring lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:23 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Acquired lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:23 devstack cinder-volume[83569]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Releasing lock "singleton_lock" {{(pid=83569) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:23 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Stop services. {{(pid=83569) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 30 10:48:23 devstack cinder-volume[83569]: DEBUG oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Killing children. {{(pid=83569) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 30 10:48:23 devstack cinder-volume[83569]: INFO oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Waiting on 1 children to exit Apr 30 10:48:27 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Acquiring lock "singleton_lock" {{(pid=83862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:27 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Acquired lock "singleton_lock" {{(pid=83862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:27 devstack cinder-volume[83862]: DEBUG oslo_concurrency.lockutils [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Releasing lock "singleton_lock" {{(pid=83862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:27 devstack cinder-volume[83862]: WARNING amqp [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 10:48:27 devstack cinder-volume[83862]: WARNING amqp [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 10:48:27 devstack cinder-volume[83569]: INFO oslo_service.backend._eventlet.service [None req-b5acbf34-6588-4cbb-95b3-4306229ea181 None None] Child 83862 exited with status 0 Apr 30 10:48:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 10:48:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 10:48:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 10:48:31 devstack cinder-volume[84197]: INFO dbcounter [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Registered counter for database cinder Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_db.sqlalchemy.engines [None req-9116e0a8-e4af-4645-af56-db806699606f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writer thread running {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:48:31 devstack cinder-volume[84197]: INFO cinder.rpc [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 10:48:31 devstack cinder-volume[84197]: INFO cinder.rpc [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_db.sqlalchemy.engines [None req-9116e0a8-e4af-4645-af56-db806699606f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Determined volume DB was empty at startup. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84197) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 10:48:31 devstack cinder-volume[84197]: WARNING stevedore.named [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 10:48:31 devstack cinder-volume[84197]: WARNING castellan.key_manager [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:48:31 devstack cinder-volume[84197]: WARNING cinder.keymgr.conf_key_mgr [None req-9116e0a8-e4af-4645-af56-db806699606f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 10:48:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_db.sqlalchemy.engines [None req-9116e0a8-e4af-4645-af56-db806699606f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:31 devstack cinder-volume[84197]: INFO oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Starting 1 workers Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Started child 84432 {{(pid=84197) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Full set of CONF: {{(pid=84197) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] ******************************************************************************** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Configuration options gathered from: {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] ================================================================================ {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] allow_availability_zone_fallback = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] allow_compression_on_image_upload = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] allowed_direct_url_schemes = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] api_rate_limit = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] auth_strategy = keystone {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_availability_zone = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_host = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_stats_polling_interval = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backup_api_class = cinder.backup.api.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backup_name_template = backup-%s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backup_use_same_host = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backup_use_temp_snapshot = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] chap_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84432]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] chap_username = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_internal_tenant_project_id = 7e62ada7b15c4a7ea7b3f7dc8ca04918 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_internal_tenant_user_id = cf027d80405a4e1cb62ad0931cdef78f {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cluster = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] compression_format = gzip {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] compute_api_class = cinder.compute.nova.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] config_dir = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] config_source = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] control_exchange = openstack {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] debug = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] default_availability_zone = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] default_group_type = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] default_volume_type = QuobyteHD {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] disk_geometry = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_client_cert = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_client_cert_key = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_data_namespace = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_ssl_cert_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_ssl_cert_verify = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] driver_use_ssl = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] enable_new_services = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] enable_unsupported_driver = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] enabled_backends = ['QuobyteHD'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] enforce_multipath_for_image_xfer = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] filter_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_api_insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_api_ssl_compression = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_ca_certificates_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_catalog_info = image:glance:publicURL {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_num_retries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance_request_timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] goodness_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] graceful_shutdown_timeout = 5 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] group_api_class = cinder.group.api.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] host = devstack {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_compress_on_upload = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_conversion_address_space_limit = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_conversion_cpu_limit = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_conversion_disable = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_upload_use_cinder_backend = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_upload_use_internal_tenant = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_volume_cache_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_volume_cache_max_count = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] image_volume_cache_max_size_gb = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] init_host_max_objects_retrieval = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] instance_format = [instance: %(uuid)s] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iscsi_target_flags = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iscsi_write_cache = on {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iser_helper = tgtadm {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iser_ip_address = 192.168.122.163 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iser_port = 3260 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_color = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_config_append = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_dir = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_options = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_rotate_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_rotate_interval_type = days {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] log_rotation_type = none {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] max_age = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] max_logfile_count = 30 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] max_logfile_size_mb = 200 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] max_over_subscription_ratio = 20.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] message_reap_interval = 86400 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] message_ttl = 2592000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] migration_create_volume_timeout_secs = 300 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] monkey_patch = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] monkey_patch_modules = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] my_ip = 192.168.122.163 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] no_snapshot_gb_quota = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] num_iser_scan_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] num_shell_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] num_volume_device_scan_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] nvmeof_conn_info_version = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] nvmet_ns_id = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] nvmet_port_id = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_max_limit = 1000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_ext_list = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Starting volume driver QuobyteDriver (1.1.14) Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84432) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_listen = 0.0.0.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_listen_port = 8776 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_use_ssl = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] osapi_volume_workers = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] per_volume_size_limit = -1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] periodic_fuzzy_delay = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] periodic_interval = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] project_id_regex = [0-9a-f\-]+ {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] public_endpoint = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] publish_errors = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_backup_gigabytes = 1000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_backups = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_gigabytes = 1000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_groups = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_snapshots = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] quota_volumes = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] rate_limit_burst = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] rate_limit_except_level = CRITICAL {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] rate_limit_interval = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] reinit_driver_count = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] replication_device = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] report_discard_supported = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] report_interval = 120 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] reservation_clean_interval = 86400 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] reservation_expire = 86400 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] reserved_image_namespaces = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] reserved_percentage = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] rpc_response_timeout = 120 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] run_external_periodic_tasks = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] scst_target_driver = iscsi {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] scst_target_iqn_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_down_time = 720 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] shell_completion = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] snapshot_name_template = snapshot-%s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] split_loggers = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] state_path = /opt/stack/data/cinder {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] storage_availability_zone = nova {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] storage_protocol = iSCSI {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] syslog_log_facility = LOG_USER {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_helper = lioadm {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_ip_address = 192.168.122.163 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_port = 3260 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_protocol = iscsi {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] target_secondary_ip_addresses = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] trace_flags = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] transfer_api_class = cinder.transfer.api.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] transport_url = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] until_refresh = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_chap_auth = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_default_quota_class = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_journal = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_json = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_multipath_for_image_xfer = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_stderr = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] use_syslog = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] verify_glance_signatures = enabled {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_api_class = cinder.volume.api.API {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_backend_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_clear = zero {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_clear_ionice = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_clear_size = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_copy_bps_limit = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_dd_blocksize = 1M {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_name_template = volume-%s {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_service_inithost_offload = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volume_usage_audit_period = month {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] zoning_mode = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_concurrency.disable_process_locking = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.admin_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.admin_token = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.admin_user = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_admin_prefix = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_port = 35357 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_protocol = https {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_section = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_type = password {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_uri = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.auth_version = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.cache = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.delay_auth_decision = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.http_connect_timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.identity_uri = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.include_service_catalog = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.interface = public {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_password = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcache_username = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.region_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.service_token_roles_required = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.service_type = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.token_cache_time = 300 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.backend = dogpile.cache.null {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.backend_argument = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.backend_expiration_time = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.config_prefix = cache.oslo {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.debug_cache_backend = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.enable_retry_client = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.enable_socket_keepalive = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.enforce_fips_mode = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.expiration_time = 600 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.hashclient_retry_attempts = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_dead_retry = 300 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_pool_maxsize = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_sasl_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.proxies = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.redis_db = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.redis_sentinel_service_name = mymaster {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.redis_server = localhost:6379 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.retry_attempts = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.retry_delay = 0.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.socket_keepalive_count = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.socket_keepalive_idle = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.socket_keepalive_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.socket_timeout = 1.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.tls_allowed_ciphers = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.tls_cafile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.tls_certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.tls_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.tls_keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cache.username = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] coordination.backend_url = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.asyncio_connection = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.asyncio_slave_connection = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.backend = sqlalchemy {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.connection = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.connection_debug = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.connection_parameters = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.connection_recycle_time = 3600 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.connection_trace = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.db_inc_retry_interval = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.db_max_retries = 20 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.db_max_retry_interval = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.db_retry_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.max_overflow = 50 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.max_pool_size = 5 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.max_retries = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.mysql_wsrep_sync_wait = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.pool_timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.retry_interval = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.slave_connection = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.sqlite_synchronous = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.synchronous_reader = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] database.use_db_reconnect = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.connection_string = messaging:// {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.es_doc_type = notification {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.es_scroll_size = 10000 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.es_scroll_time = 2m {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.filter_error_trace = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.hmac_keys = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.sentinel_service_name = mymaster {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.socket_timeout = 0.1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84432) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.trace_requests = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler.trace_sqlalchemy = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler_jaeger.process_tags = {} {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler_jaeger.service_name_prefix = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] profiler_otlp.service_name_prefix = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.enforce_new_defaults = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: WARNING oslo_config.cfg [None req-9116e0a8-e4af-4645-af56-db806699606f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Running cmd (subprocess): mount.quobyte {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.enforce_scope = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.policy_default_rule = default {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.policy_file = policy.yaml {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_policy.remote_timeout = 60.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.group = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.helper_command = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] privsep_osbrick.user = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.group = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.helper_command = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] cinder_sys_admin.user = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.auth_section = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.auth_type = password {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.cafile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.collect_timing = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.send_service_user_token = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.split_loggers = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] service_user.timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.auth_section = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.auth_type = password {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.collect_timing = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.region_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.split_loggers = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] glance.timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.backend_availability_zone = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.chap_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.chap_username = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.disk_geometry = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_client_cert = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_client_cert_key = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_data_namespace = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.driver_use_ssl = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.enable_unsupported_driver = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.extra_capabilities = {} {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.filter_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.goodness_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iscsi_target_flags = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iscsi_write_cache = on {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iser_helper = tgtadm {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iser_port = 3260 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_host = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_login = admin {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_mount_options = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_private_key = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_share_path = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_ssh_port = 22 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.num_shell_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.nvmet_port_id = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_client_cfg = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.quobyte_volume_url = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.replication_device = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.report_discard_supported = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.reserved_percentage = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.scst_target_driver = iscsi {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.scst_target_iqn_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.storage_protocol = iSCSI {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_helper = tgtadm {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_port = 3260 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_protocol = iscsi {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.trace_flags = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.unique_fqdn_network = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.use_chap_auth = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_backend_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_clear = zero {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_clear_ionice = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_clear_size = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_reports.file_event_handler = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_reports.log_dir = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.backend_availability_zone = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.backend_host = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.chap_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.chap_username = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.chiscsi_conf = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.disk_geometry = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_client_cert = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_client_cert_key = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_data_namespace = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.driver_use_ssl = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.extra_capabilities = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.filter_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.goodness_function = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iscsi_target_flags = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iscsi_write_cache = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iser_helper = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iser_ip_address = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iser_port = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.iser_target_prefix = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_host = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_login = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_mount_options = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_password = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_private_key = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_share_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_ssh_port = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.num_shell_tries = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nvmet_ns_id = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.nvmet_port_id = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.replication_device = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.report_discard_supported = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.reserved_percentage = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.scst_target_driver = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.storage_protocol = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_helper = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_ip_address = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_port = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_prefix = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_protocol = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.trace_flags = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.unique_fqdn_network = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.use_chap_auth = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_clear = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_clear_ionice = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_clear_size = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack quobyte-client[84438]: Reading configuration file: /etc/quobyte/client.cfg Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] QuobyteHD.volumes_dir = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack quobyte-client[84438]: Invalid parameters found, error: missing mount point. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack quobyte-client[84438]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack quobyte-client[84438]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.ssl_version = {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_notifications.driver = [] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_notifications.retry = -1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] oslo_messaging_notifications.transport_url = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] key_manager.fixed_key = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.barbican_api_version = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.barbican_endpoint = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.barbican_endpoint_type = public {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.barbican_region_name = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.cafile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.collect_timing = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.number_of_retries = 60 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.retry_delay = 1 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.send_service_user_token = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.split_loggers = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.verify_ssl = True {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican.verify_ssl_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.auth_section = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.auth_type = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.cafile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.certfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.collect_timing = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.insecure = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.keyfile = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.split_loggers = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] barbican_service_user.timeout = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:31 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.approle_role_id = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.approle_secret_id = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.kv_mountpoint = secret {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.kv_path = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.kv_version = 2 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.namespace = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.root_token_id = **** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.ssl_ca_crt_file = None {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.timeout = 60.0 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.use_ssl = False {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 10:48:32 devstack cinder-volume[84197]: DEBUG oslo_service.backend._eventlet.service [None req-9116e0a8-e4af-4645-af56-db806699606f None None] ******************************************************************************** {{(pid=84197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 10:48:32 devstack sudo[84439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:32 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:32 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.676s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:32 devstack cinder-volume[84432]: INFO cinder.volume.driver [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Driver hasn't implemented _init_vendor_properties() Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG cinder.volume.driver [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7126998901367, 'free_capacity_gb': 1775.7126998901367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84432) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_db.sqlalchemy.engines [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writer thread running {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG cinder.db.sqlalchemy.api [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Building query based on filter {{(pid=84432) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84432) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:32 devstack cinder-volume[84432]: INFO cinder.keymgr.migration [None req-cf8b848b-d97d-46f4-93f3-ce1d8730475f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 10:48:32 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:32 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:33 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.568s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:48:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Driver initialization completed successfully. Apr 30 10:48:33 devstack cinder-volume[84432]: INFO cinder.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Initiating service 3 cleanup Apr 30 10:48:33 devstack cinder-volume[84432]: INFO cinder.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Service 3 cleanup completed. Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG cinder.service [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Creating RPC server for service cinder-volume {{(pid=84432) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG cinder.service [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84432) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 10:48:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:48:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:48:33 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:48:33 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:48:34 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Apr 30 10:48:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:48:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-36cafb12-8e49-400e-ac33-23af29924c9d None None] Driver post RPC initialization completed successfully. Apr 30 10:48:41 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:48:43 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:48:44 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (5821888e-0d91-4819-8fc1-33bf574a658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb718ad-1869-4708-a0cf-8f8682199f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb718ad-1869-4708-a0cf-8f8682199f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1410691743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05c697a-eafd-4c9f-a913-fd8ab54aa920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:31Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b12fe65-c8c4-42b2-b3bd-e32377d97a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b12fe65-c8c4-42b2-b3bd-e32377d97a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94171e5a-93a1-4360-be59-f1dd82d1bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:30 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94171e5a-93a1-4360-be59-f1dd82d1bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e05c697a-eafd-4c9f-a913-fd8ab54aa920', 'volume_name': 'volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a1486-c5ea-4ea4-8751-623a1fb63b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a1486-c5ea-4ea4-8751-623a1fb63b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a9e0ee-9c3f-49cf-8336-0d770a2b3f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Volume e05c697a-eafd-4c9f-a913-fd8ab54aa920: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Trying to clone e05c697a-eafd-4c9f-a913-fd8ab54aa920 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 10:49:31 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 10:49:31 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Image download 20.69 MB at 20.69 MB/s Apr 30 10:49:31 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbi49uhu5/privsep.sock'] Apr 30 10:49:31 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbi49uhu5/privsep.sock Apr 30 10:49:31 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:33 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:33 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Spawned new privsep daemon via rootwrap Apr 30 10:49:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Accepted privsep connection to /tmp/tmpbi49uhu5/privsep.sock {{(pid=84432) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 30 10:49:33 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 30 10:49:33 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 30 10:49:33 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 30 10:49:33 devstack cinder-volume[84432]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84601 Apr 30 10:49:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b17890-7cb2-45dd-9fb5-f37418692fa0]: (2,) {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b19d1-1e51-425a-9ab0-8651d979ce3a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:33 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD Apr 30 10:49:33 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:34 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD" returned: 0 in 0.879s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:34 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 78c041ff04de4c58ba2f3e7f65b190ad. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 10:49:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1a6bc-4f75-4edd-9580-f41a14888066]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:34 devstack sudo[84616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD Apr 30 10:49:34 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:35 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1410691743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05c697a-eafd-4c9f-a913-fd8ab54aa920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:31Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Creating volume e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:49:35 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:49:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:35 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1073741824 Apr 30 10:49:35 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:36 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1073741824" returned: 0 in 1.145s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:36 devstack sudo[84980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:49:36 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:37 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 0.833s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e05c697a-eafd-4c9f-a913-fd8ab54aa920. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec38403-35ed-46eb-aa2f-e1cde3f6fa05]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:37 devstack sudo[84983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0 Apr 30 10:49:37 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:38 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0" returned: 0 in 0.919s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:38 devstack sudo[84988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0 Apr 30 10:49:38 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:39 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0" returned: 1 in 0.995s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n_o3gsx0' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:49:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebec9a6c-44ba-4426-bd85-d181046af316]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:39 devstack sudo[84994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD Apr 30 10:49:39 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Flow 'volume_create_manager' (21ea2274-073a-48d2-aad8-aa6317e40da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6291d4-c719-4936-940b-c31eea6ac29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6291d4-c719-4936-940b-c31eea6ac29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-196627045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fed0a2a-1c6b-49a7-8376-b9565154e7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b26f1b96a2c4f8bb0ee284bf37fefac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:40Z,use_quota=True,user_id='f815aa343313432b906fb67ded2fd31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa4f5da-35f7-4c7e-9f12-2da011cb4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa4f5da-35f7-4c7e-9f12-2da011cb4075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bb63c5-16fe-495b-bc3c-ac55300cdac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bb63c5-16fe-495b-bc3c-ac55300cdac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fed0a2a-1c6b-49a7-8376-b9565154e7f5', 'volume_name': 'volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517bbeeb-0dd7-4605-83cc-3dc7be71a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517bbeeb-0dd7-4605-83cc-3dc7be71a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697c6ac-0040-40f5-92af-02fbc8ca0b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Volume 8fed0a2a-1c6b-49a7-8376-b9565154e7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5', 'volume_size': 1} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-196627045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fed0a2a-1c6b-49a7-8376-b9565154e7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b26f1b96a2c4f8bb0ee284bf37fefac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:40Z,use_quota=True,user_id='f815aa343313432b906fb67ded2fd31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Creating volume 8fed0a2a-1c6b-49a7-8376-b9565154e7f5 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:49:40 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:40 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 1073741824 Apr 30 10:49:40 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:40 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD" returned: 0 in 0.909s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 10:49:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:40 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:49:40 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:41 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 1073741824" returned: 0 in 1.084s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:41 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 Apr 30 10:49:41 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:42 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697c6ac-0040-40f5-92af-02fbc8ca0b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d5d161-50f8-4be3-bdb7-f08968a3f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Volume volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 (8fed0a2a-1c6b-49a7-8376-b9565154e7f5): created successfully Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d5d161-50f8-4be3-bdb7-f08968a3f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Flow 'volume_create_manager' (21ea2274-073a-48d2-aad8-aa6317e40da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-40608968-33bc-4073-9b35-27f177f4b3bc tempest-VolumesAssistedSnapshotsTest-2085164625 None] Created volume successfully. Apr 30 10:49:43 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 2.852s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:43 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_n7ph4nn4devstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:49:43 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Converted 112.00 MB image at 39.25 MB/s Apr 30 10:49:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:43 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1G Apr 30 10:49:43 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:44 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 1G" returned: 0 in 0.989s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad75f07-82ab-4fd9-b30e-a738e42395d0]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:49:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:44 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:49:44 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:45 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 1.111s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:45 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:49:45 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:46 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 1 in 0.915s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e05c697a-eafd-4c9f-a913-fd8ab54aa920 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 78c041ff04de4c58ba2f3e7f65b190ad is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Marking volume e05c697a-eafd-4c9f-a913-fd8ab54aa920 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to e05c697a-eafd-4c9f-a913-fd8ab54aa920. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Creating volume glance metadata for volume e05c697a-eafd-4c9f-a913-fd8ab54aa920 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a9e0ee-9c3f-49cf-8336-0d770a2b3f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e5348d-2613-4f7a-843e-54763e85859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Volume volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 (e05c697a-eafd-4c9f-a913-fd8ab54aa920): created successfully Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e5348d-2613-4f7a-843e-54763e85859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (5821888e-0d91-4819-8fc1-33bf574a658d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-45bd5e3f-c469-4fc9-afb7-83aee34a4f1c tempest-TaggedBootDevicesTest-50121462 None] Created volume successfully. Apr 30 10:49:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:49:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (85fe5785-72ac-4ded-85ff-b60ee6163d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c765222-2040-4fe3-8228-db505944134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c765222-2040-4fe3-8228-db505944134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-589254461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4dbbfb-7fa6-4019-9327-b4e68ace491c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:48Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55651fea-138a-42eb-9194-31f653512d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55651fea-138a-42eb-9194-31f653512d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0bc648-5aaa-484c-922a-8ee28981aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0bc648-5aaa-484c-922a-8ee28981aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4dbbfb-7fa6-4019-9327-b4e68ace491c', 'volume_name': 'volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb8b3f2-575a-47b1-be5b-606312b0be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb8b3f2-575a-47b1-be5b-606312b0be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3623ef55-77ea-4ce4-b34c-fa54708371b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Volume aa4dbbfb-7fa6-4019-9327-b4e68ace491c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c', 'volume_size': 1} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-589254461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4dbbfb-7fa6-4019-9327-b4e68ace491c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:48Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Creating volume aa4dbbfb-7fa6-4019-9327-b4e68ace491c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:49:48 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:49:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:48 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c 1073741824 Apr 30 10:49:48 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:49 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c 1073741824" returned: 0 in 0.928s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:49 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c Apr 30 10:49:49 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:49 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" returned: 0 in 0.734s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3623ef55-77ea-4ce4-b34c-fa54708371b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571080e4-7ad5-4f90-958c-89d86831a264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Volume volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c (aa4dbbfb-7fa6-4019-9327-b4e68ace491c): created successfully Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571080e4-7ad5-4f90-958c-89d86831a264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (85fe5785-72ac-4ded-85ff-b60ee6163d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-55798a0f-d677-4692-8814-0a0808166783 tempest-TaggedBootDevicesTest-50121462 None] Created volume successfully. Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (307bc597-2976-483f-b845-5b11078de60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21bd9a-7612-4422-90f0-fd0ad6c0f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21bd9a-7612-4422-90f0-fd0ad6c0f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-641627790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a0da92-b395-4e7c-8a1e-0ec30c52deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:51Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca4526d-4957-4d42-a0d3-1aae38c26d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca4526d-4957-4d42-a0d3-1aae38c26d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e38bf0-21ae-440c-aa4c-c552a9e175f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e38bf0-21ae-440c-aa4c-c552a9e175f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a0da92-b395-4e7c-8a1e-0ec30c52deb2', 'volume_name': 'volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ca1f18-1823-402e-ba8d-95ae9c87fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ca1f18-1823-402e-ba8d-95ae9c87fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f8f5e5-37d2-4bcb-8403-a570fd75be14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:50 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Volume 90a0da92-b395-4e7c-8a1e-0ec30c52deb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2', 'volume_size': 1} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-641627790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a0da92-b395-4e7c-8a1e-0ec30c52deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db52e6764b4419e846a645d7aae9981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:49:51Z,use_quota=True,user_id='78c041ff04de4c58ba2f3e7f65b190ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Creating volume 90a0da92-b395-4e7c-8a1e-0ec30c52deb2 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:49:50 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:49:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:50 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 1073741824 Apr 30 10:49:50 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:51 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 1073741824" returned: 0 in 0.866s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:49:51 devstack sudo[85108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 Apr 30 10:49:51 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:49:52 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" returned: 0 in 0.708s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f8f5e5-37d2-4bcb-8403-a570fd75be14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7229e9-a1af-43c2-9a6f-7eb86f8bc0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:49:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Volume volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 (90a0da92-b395-4e7c-8a1e-0ec30c52deb2): created successfully Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7229e9-a1af-43c2-9a6f-7eb86f8bc0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:49:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Flow 'volume_create_manager' (307bc597-2976-483f-b845-5b11078de60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:49:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7fe2019e-a180-404f-8b4b-d575817ac038 tempest-TaggedBootDevicesTest-50121462 None] Created volume successfully. Apr 30 10:50:02 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=17,cinder:SELECT=14,cinder:INSERT=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:50:02 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=10,cinder:DELETE=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:06 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:50:06 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:06 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.716s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:50:24 devstack cinder-volume[84432]: WARNING py.warnings [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 30 10:50:24 devstack cinder-volume[84432]: .first() Apr 30 10:50:24 devstack cinder-volume[84432]: Apr 30 10:50:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7af23-e4b1-4285-a8e1-73f9b67f46ce]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:25 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:50:25 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:26 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 1.876s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:26 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:50:26 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:28 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 1 in 1.258s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.200s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a71005b7-ee16-4bcc-a3ed-725ff3c5f8ed', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-2f80b3d8-74b0-4056-af7b-fe7daa9896aa tempest-TaggedBootDevicesTest-50121462 None] attachment_update completed successfully. Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Flow 'volume_create_manager' (ce52f809-9e16-4142-86e7-c6122b3c2327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc0ec-118b-4b01-9270-6cad2f653525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc0ec-118b-4b01-9270-6cad2f653525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1736987551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154df92b-3eed-485b-a4ef-793faf63e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd71ec0be037409f88eae386390bc69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:50:28Z,use_quota=True,user_id='87ff032dbfd64078845b38922c820ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d32593-ad35-4d7a-8e6d-cff6e6da077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d32593-ad35-4d7a-8e6d-cff6e6da077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a244392d-93bf-4a5a-abf2-59af92eb9942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a244392d-93bf-4a5a-abf2-59af92eb9942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154df92b-3eed-485b-a4ef-793faf63e425', 'volume_name': 'volume-154df92b-3eed-485b-a4ef-793faf63e425', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b358a-6b72-441e-9c17-cdc5786b1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8b358a-6b72-441e-9c17-cdc5786b1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac05807-0a64-41fc-a77c-93338c55361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Volume 154df92b-3eed-485b-a4ef-793faf63e425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154df92b-3eed-485b-a4ef-793faf63e425', 'volume_size': 1} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1736987551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154df92b-3eed-485b-a4ef-793faf63e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd71ec0be037409f88eae386390bc69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:50:28Z,use_quota=True,user_id='87ff032dbfd64078845b38922c820ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Creating volume 154df92b-3eed-485b-a4ef-793faf63e425 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:50:28 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:50:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:28 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 1073741824 Apr 30 10:50:28 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:30 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 1073741824" returned: 0 in 1.251s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:30 devstack sudo[85557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 Apr 30 10:50:30 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:50:31 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Flow 'volume_create_manager' (c49e45b9-ceac-4b7a-9684-be698ed394d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875bb36-b723-4f15-bd05-38af84c69ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425" returned: 0 in 1.119s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] <== create_volume: return (2460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.555s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875bb36-b723-4f15-bd05-38af84c69ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-757918333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0a4233-6c62-42a7-91f3-a26b220f6879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa47c3b7d3a4e3f8a4e78d1005333ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:50:31Z,use_quota=True,user_id='fcb8888163a142f6aed1558863137ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65074965-1ea8-4f59-bffd-f5979233b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65074965-1ea8-4f59-bffd-f5979233b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff11e891-efa1-4730-9aaf-81b08a4b0b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff11e891-efa1-4730-9aaf-81b08a4b0b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f0a4233-6c62-42a7-91f3-a26b220f6879', 'volume_name': 'volume-5f0a4233-6c62-42a7-91f3-a26b220f6879', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42712d5-b831-4825-b5d1-eb42608ea108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42712d5-b831-4825-b5d1-eb42608ea108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29539cc2-cf57-40a1-b190-35613041a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Volume 5f0a4233-6c62-42a7-91f3-a26b220f6879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f0a4233-6c62-42a7-91f3-a26b220f6879', 'volume_size': 1} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c411db-4c53-4291-a5b7-fb6b9bc9f5ba]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac05807-0a64-41fc-a77c-93338c55361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154df92b-3eed-485b-a4ef-793faf63e425', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f7c299-3fe4-4112-98ed-3b6ccbbdc9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Volume volume-154df92b-3eed-485b-a4ef-793faf63e425 (154df92b-3eed-485b-a4ef-793faf63e425): created successfully Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f7c299-3fe4-4112-98ed-3b6ccbbdc9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Flow 'volume_create_manager' (ce52f809-9e16-4142-86e7-c6122b3c2327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:50:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-80cf7ca5-a4c0-47c9-8bab-fe2b77b0884b tempest-AttachSCSIVolumeTestJSON-583687353 None] Created volume successfully. Apr 30 10:50:31 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c Apr 30 10:50:31 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:32 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" returned: 0 in 0.944s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-757918333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0a4233-6c62-42a7-91f3-a26b220f6879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa47c3b7d3a4e3f8a4e78d1005333ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:50:31Z,use_quota=True,user_id='fcb8888163a142f6aed1558863137ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Creating volume 5f0a4233-6c62-42a7-91f3-a26b220f6879 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:50:32 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:32 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 1073741824 Apr 30 10:50:32 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '113e142d-723f-4c31-9a7a-404443393669', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-3e760c24-8aca-4560-b72e-e66e551ad76f tempest-TaggedBootDevicesTest-50121462 None] attachment_update completed successfully. Apr 30 10:50:33 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 1073741824" returned: 0 in 0.972s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:33 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 Apr 30 10:50:33 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:33 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879" returned: 0 in 0.634s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29539cc2-cf57-40a1-b190-35613041a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f0a4233-6c62-42a7-91f3-a26b220f6879', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cb3d01-0b7c-49ad-b7ee-8931ec46c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:50:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Volume volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 (5f0a4233-6c62-42a7-91f3-a26b220f6879): created successfully Apr 30 10:50:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cb3d01-0b7c-49ad-b7ee-8931ec46c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:50:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Flow 'volume_create_manager' (c49e45b9-ceac-4b7a-9684-be698ed394d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:50:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4030a831-56b6-48f3-b424-06dda220220f tempest-DeleteServersTestJSON-405468824 None] Created volume successfully. Apr 30 10:50:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48f2d17-015c-4536-95a3-284e0b749d95]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:34 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 Apr 30 10:50:34 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:35 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" returned: 0 in 1.191s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.226s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7985c21f-96eb-4744-8a92-927f82489929', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-dbbb75e4-d99e-4f96-a099-1a9ec635642a req-fcb0fa63-e9d3-4b45-9762-9515f6b8f6f9 tempest-TaggedBootDevicesTest-50121462 None] attachment_update completed successfully. Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3679d2c5-eb23-4fae-ad24-7c5dcd9eac90]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:36 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 Apr 30 10:50:36 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:37 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425" returned: 0 in 1.117s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.162s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-154df92b-3eed-485b-a4ef-793faf63e425', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f92722-9132-40f8-adcc-9029f381c592', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-22182dde-3dcf-4a1c-9fa2-13d44814d0a9 req-d019aa2b-2de7-4a02-b653-922472141d4b tempest-AttachSCSIVolumeTestJSON-583687353 None] attachment_update completed successfully. Apr 30 10:50:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7121702-6cd1-4de4-9164-e3153196e037]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:39 devstack sudo[85757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 Apr 30 10:50:39 devstack sudo[85757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:40 devstack sudo[85757]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879" returned: 0 in 1.662s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.694s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-5f0a4233-6c62-42a7-91f3-a26b220f6879', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dbac6bb-3adf-4d63-8ccd-bd570f1ef423', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-ef6650cc-d7e8-49ef-a5b6-5f2d63bb14f2 req-c41cd36d-d2c6-4d3b-aa85-47d840e7da99 tempest-DeleteServersTestJSON-405468824 None] attachment_update completed successfully. Apr 30 10:50:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-74804baa-5667-470d-8441-a42777c6caa1 req-1d7491cd-45fc-4fb5-b53f-422ef78e6e6b tempest-AttachSCSIVolumeTestJSON-583687353 None] Terminate volume connection completed successfully. Apr 30 10:50:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-74804baa-5667-470d-8441-a42777c6caa1 req-1d7491cd-45fc-4fb5-b53f-422ef78e6e6b tempest-AttachSCSIVolumeTestJSON-583687353 None] Deleting attachment f9f92722-9132-40f8-adcc-9029f381c592. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:50:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[522366a9-2bf3-4e49-829b-7a3003444234]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:45 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 Apr 30 10:50:45 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:46 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" returned: 0 in 0.855s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e1fcb6a-7934-4eb9-b295-5f2aa4b997a2', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:50:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-aa2e01b7-8d3d-4287-83b2-b67a2c52a677 req-bfe09aa9-0ab0-4517-9792-4127235b199f tempest-VolumesAssistedSnapshotsTest-2085164625 None] attachment_update completed successfully. Apr 30 10:50:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-1e4a2e7e-31ed-4562-85e7-afa03a21ec5d req-f15f387f-f30e-4700-bd7c-80e58f1d34d4 tempest-DeleteServersTestJSON-405468824 None] Terminate volume connection completed successfully. Apr 30 10:50:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-1e4a2e7e-31ed-4562-85e7-afa03a21ec5d req-f15f387f-f30e-4700-bd7c-80e58f1d34d4 tempest-DeleteServersTestJSON-405468824 None] Deleting attachment 8dbac6bb-3adf-4d63-8ccd-bd570f1ef423. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:50:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-cf520805-62b9-457a-a8db-07d46aaa7980 req-3fe5c3bd-15cb-4d44-91cd-0df7db396f0d tempest-VolumesAssistedSnapshotsTest-2085164625 None] Terminate volume connection completed successfully. Apr 30 10:50:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cf520805-62b9-457a-a8db-07d46aaa7980 req-3fe5c3bd-15cb-4d44-91cd-0df7db396f0d tempest-VolumesAssistedSnapshotsTest-2085164625 None] Deleting attachment 2e1fcb6a-7934-4eb9-b295-5f2aa4b997a2. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "cinder-5f0a4233-6c62-42a7-91f3-a26b220f6879-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "cinder-5f0a4233-6c62-42a7-91f3-a26b220f6879-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "cinder-8fed0a2a-1c6b-49a7-8376-b9565154e7f5-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "cinder-quobyte-5f0a4233-6c62-42a7-91f3-a26b220f6879" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "cinder-8fed0a2a-1c6b-49a7-8376-b9565154e7f5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "cinder-quobyte-5f0a4233-6c62-42a7-91f3-a26b220f6879" acquired by "delete_volume" :: waited 0.049s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "cinder-quobyte-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[00823889-2734-4218-a277-9752ceb809ec]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "cinder-quobyte-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" acquired by "delete_volume" :: waited 0.038s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d955c8f4-edd3-4fac-b2c0-9cb897209347]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:56 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 Apr 30 10:50:56 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:56 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 Apr 30 10:50:56 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:57 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879" returned: 0 in 1.198s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:57 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879 Apr 30 10:50:57 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:57 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" returned: 0 in 1.241s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:58 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5 Apr 30 10:50:58 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:58 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f0a4233-6c62-42a7-91f3-a26b220f6879" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "cinder-quobyte-5f0a4233-6c62-42a7-91f3-a26b220f6879" released by "delete_volume" :: held 1.946s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:50:58 devstack cinder-volume[84432]: WARNING cinder.quota [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:50:58 devstack cinder-volume[84432]: WARNING cinder.quota [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Created reservations ['e75adebf-867d-492e-aac2-36ffa3a6f985', '3a85c488-175f-414d-b3ec-96cffe80b1d5', 'd3a4b9a7-4c59-4fd1-bf32-e2ce0d74b42e', '0ff78e6e-784a-47bd-a766-91b3b5b6c77b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:50:58 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" returned: 0 in 0.716s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "cinder-quobyte-8fed0a2a-1c6b-49a7-8376-b9565154e7f5" released by "delete_volume" :: held 2.012s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:58 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:50:58 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Created reservations ['4bb96980-46af-4acd-9f2d-a1e8d05dc9fb', 'a18b8689-e467-42f7-a5df-932325eaa5a9', 'b46adcfe-d645-46a9-97bd-0ff9004a34ca', '3f28abb4-94ea-456d-92a4-d7b96a34ef0d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:50:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:59 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:50:59 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:50:59 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.752s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:50:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Deleted volume successfully. Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1926b324-d403-4290-a12a-3e0aca84176d tempest-DeleteServersTestJSON-405468824 None] Lock "cinder-5f0a4233-6c62-42a7-91f3-a26b220f6879-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "cinder-154df92b-3eed-485b-a4ef-793faf63e425-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "cinder-154df92b-3eed-485b-a4ef-793faf63e425-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "cinder-quobyte-154df92b-3eed-485b-a4ef-793faf63e425" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "cinder-quobyte-154df92b-3eed-485b-a4ef-793faf63e425" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5696f-606f-4a08-bbed-d2f247a3f22f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:50:59 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.899s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:50:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Deleted volume successfully. Apr 30 10:50:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-75b8ab19-f85d-4d53-985f-a21ed7708bab tempest-VolumesAssistedSnapshotsTest-2085164625 None] Lock "cinder-8fed0a2a-1c6b-49a7-8376-b9565154e7f5-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:50:59 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 Apr 30 10:50:59 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:00 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425" returned: 0 in 1.002s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:00 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425 Apr 30 10:51:00 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:01 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-154df92b-3eed-485b-a4ef-793faf63e425" returned: 0 in 0.837s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "cinder-quobyte-154df92b-3eed-485b-a4ef-793faf63e425" released by "delete_volume" :: held 1.906s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Created reservations ['2b44b87f-bd4f-48c2-bf07-08f0d1bf306b', '78021b27-2873-48cb-af9a-bf26109b167a', '6296b38f-184b-4381-8b2e-aae4820527c7', '90ef6fd5-c5ac-4331-bb9a-944b31f21022'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:01 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:51:01 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:02 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.943s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:02 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:51:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Deleted volume successfully. Apr 30 10:51:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-295bee42-e1c5-4356-a164-919e284e35b9 tempest-AttachSCSIVolumeTestJSON-583687353 None] Lock "cinder-154df92b-3eed-485b-a4ef-793faf63e425-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:06 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:51:06 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:07 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.972s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:51:11 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=54,cinder:UPDATE=48,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:51:12 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Flow 'volume_create_manager' (d47b916c-bc4f-4fdb-b7b3-19fff94b56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122183b2-96ec-429c-a8f8-52ed410f6d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122183b2-96ec-429c-a8f8-52ed410f6d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-753322060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeb6e48-8d6b-446a-bc0e-a2cde30253e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092bec29beae4d9e8d1a720b62a210e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:51:40Z,use_quota=True,user_id='ced578a1cb514baeae67414cfb3e7da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d870e4-7d52-4a2e-95b4-2593070088a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d870e4-7d52-4a2e-95b4-2593070088a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bce3be4-6d3e-496f-ac25-086c7ecec8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bce3be4-6d3e-496f-ac25-086c7ecec8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eeb6e48-8d6b-446a-bc0e-a2cde30253e9', 'volume_name': 'volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55901d07-394f-4c4e-a7b6-e38ca1474b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55901d07-394f-4c4e-a7b6-e38ca1474b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119386ee-35bb-45e9-825c-aa4a764b64e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Volume 0eeb6e48-8d6b-446a-bc0e-a2cde30253e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9', 'volume_size': 1} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-753322060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeb6e48-8d6b-446a-bc0e-a2cde30253e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092bec29beae4d9e8d1a720b62a210e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:51:40Z,use_quota=True,user_id='ced578a1cb514baeae67414cfb3e7da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Creating volume 0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:51:40 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:51:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:40 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 1073741824 Apr 30 10:51:40 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:41 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 1073741824" returned: 0 in 0.853s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:41 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 Apr 30 10:51:41 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:41 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" returned: 0 in 0.774s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119386ee-35bb-45e9-825c-aa4a764b64e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9135739b-501f-408e-a3e9-1a343cccfad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:41 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Volume volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 (0eeb6e48-8d6b-446a-bc0e-a2cde30253e9): created successfully Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9135739b-501f-408e-a3e9-1a343cccfad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Flow 'volume_create_manager' (d47b916c-bc4f-4fdb-b7b3-19fff94b56fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:51:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-79d8416a-cc1d-4e38-bb88-3b1eddb4428a tempest-TaggedAttachmentsTest-1174198043 None] Created volume successfully. Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (5043efc7-4e89-45e9-830e-3b235944b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a7d04b-f73c-4c37-bef1-3277c59311db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a7d04b-f73c-4c37-bef1-3277c59311db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-363027829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f21278c-ce0e-4c50-bb6e-2239ba2e6f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:51:49Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0891d9c-5e12-4a89-b59e-03bc6c4f025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0891d9c-5e12-4a89-b59e-03bc6c4f025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a5ede-3758-45a2-98c4-c25f294362df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a5ede-3758-45a2-98c4-c25f294362df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f21278c-ce0e-4c50-bb6e-2239ba2e6f66', 'volume_name': 'volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb34a79a-de9b-4b55-8fab-008abe8ebc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb34a79a-de9b-4b55-8fab-008abe8ebc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0549a3d2-100a-4736-9dd9-a151d97590c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:51:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 10:51:49 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Trying to clone 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 10:51:50 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 10:51:50 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Image download 20.69 MB at 20.69 MB/s Apr 30 10:51:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4256243-6c7f-4a8a-b5b9-1afcc77a5b44]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:51:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:50 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD Apr 30 10:51:50 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:51 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:51 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 9ffe22f2f53f4821bdb920cb255ea104. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 10:51:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d425891-e0d1-4a73-9c40-af034f38acfd]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:51:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:51 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD Apr 30 10:51:51 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:52 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD" returned: 0 in 1.574s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-363027829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f21278c-ce0e-4c50-bb6e-2239ba2e6f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:51:49Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Creating volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:51:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:51:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:52 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1073741824 Apr 30 10:51:52 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:53 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1073741824" returned: 0 in 1.055s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:53 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:51:53 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:54 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 0.673s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b6aff-3cb7-469c-a3b4-59e7a40bdfa3]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:51:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:54 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws Apr 30 10:51:54 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:55 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws" returned: 0 in 0.890s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:55 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws Apr 30 10:51:55 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:56 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws" returned: 1 in 0.802s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_z8c1gsws' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:51:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92636a-e4d0-47b5-8484-e71434b3cc25]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:51:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:56 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD Apr 30 10:51:56 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:57 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:57 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 10:51:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:57 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:51:57 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:51:59 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 30 10:51:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 2.448s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:51:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_iyx13xjcdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:51:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Converted 112.00 MB image at 45.66 MB/s Apr 30 10:51:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:51:59 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1G Apr 30 10:51:59 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:00 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 1G" returned: 0 in 0.745s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc17841-df2f-4153-9ae1-d9d791d157b2]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:00 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:52:00 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:01 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 0.950s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:01 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:52:01 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:02 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 1 in 0.793s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 9ffe22f2f53f4821bdb920cb255ea104 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Marking volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Creating volume glance metadata for volume 5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0549a3d2-100a-4736-9dd9-a151d97590c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46da3670-3f5c-4dd3-b8a8-4c2908c481a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 (5f21278c-ce0e-4c50-bb6e-2239ba2e6f66): created successfully Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46da3670-3f5c-4dd3-b8a8-4c2908c481a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (5043efc7-4e89-45e9-830e-3b235944b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e70e801f-d1e7-493e-93c6-a783787866c8 tempest-TaggedBootDevicesTest_v242-1737659932 None] Created volume successfully. Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (8f45b46c-523b-4334-9b9f-15bbd65e5267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d86cb59-e71e-4812-8f21-5ab0775a54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d86cb59-e71e-4812-8f21-5ab0775a54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-913082977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d20354-1e55-4950-aeca-b1f0832e45f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:04Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cb7b6-5c63-4e4e-9121-04f474dedb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cb7b6-5c63-4e4e-9121-04f474dedb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708f3da-88d5-434e-a331-4e9f3c5d14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708f3da-88d5-434e-a331-4e9f3c5d14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d20354-1e55-4950-aeca-b1f0832e45f8', 'volume_name': 'volume-b5d20354-1e55-4950-aeca-b1f0832e45f8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30eff71-5365-4739-9162-a2112898790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30eff71-5365-4739-9162-a2112898790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30780a6c-fa1e-4b8f-9fe9-d0d00696cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:03 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume b5d20354-1e55-4950-aeca-b1f0832e45f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d20354-1e55-4950-aeca-b1f0832e45f8', 'volume_size': 1} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-913082977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d20354-1e55-4950-aeca-b1f0832e45f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:04Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Creating volume b5d20354-1e55-4950-aeca-b1f0832e45f8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:52:03 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:52:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:03 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 1073741824 Apr 30 10:52:03 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-450abe68-eaaf-494f-bfbc-336de1b57f07 tempest-TaggedBootDevicesTest-50121462 None] Terminate volume connection completed successfully. Apr 30 10:52:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-450abe68-eaaf-494f-bfbc-336de1b57f07 tempest-TaggedBootDevicesTest-50121462 None] Deleting attachment a71005b7-ee16-4bcc-a3ed-725ff3c5f8ed. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:52:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-fb8a1dc1-c2c2-4cc3-9c58-fd0e28e794d4 tempest-TaggedBootDevicesTest-50121462 None] Terminate volume connection completed successfully. Apr 30 10:52:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-fb8a1dc1-c2c2-4cc3-9c58-fd0e28e794d4 tempest-TaggedBootDevicesTest-50121462 None] Deleting attachment 113e142d-723f-4c31-9a7a-404443393669. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:52:04 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 1073741824" returned: 0 in 1.067s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:05 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 Apr 30 10:52:05 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-769db49e-2e98-4787-ae79-9eca1499105e tempest-TaggedBootDevicesTest-50121462 None] Terminate volume connection completed successfully. Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9497885e-5373-49b1-ae69-bf805f9f48a0 req-769db49e-2e98-4787-ae79-9eca1499105e tempest-TaggedBootDevicesTest-50121462 None] Deleting attachment 7985c21f-96eb-4744-8a92-927f82489929. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:52:05 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30780a6c-fa1e-4b8f-9fe9-d0d00696cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d20354-1e55-4950-aeca-b1f0832e45f8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1255d0-0437-426d-9cdb-579c597a25cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:05 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 (b5d20354-1e55-4950-aeca-b1f0832e45f8): created successfully Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1255d0-0437-426d-9cdb-579c597a25cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (8f45b46c-523b-4334-9b9f-15bbd65e5267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d06509f1-a070-41f8-bed0-3a2a34039d25 tempest-TaggedBootDevicesTest_v242-1737659932 None] Created volume successfully. Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:06 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:52:06 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (e0dd3e57-e4f4-41ae-9b6a-caa15688fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f600e47d-877b-42fe-b71b-c3da65d515bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f600e47d-877b-42fe-b71b-c3da65d515bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1432687943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b3a378-6172-464b-97ac-02905593caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:06Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25b96a8-9f88-40cc-9d8b-38d5582e21b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25b96a8-9f88-40cc-9d8b-38d5582e21b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdb922-39ae-40b0-86d9-b945823e4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdb922-39ae-40b0-86d9-b945823e4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b3a378-6172-464b-97ac-02905593caf8', 'volume_name': 'volume-b5b3a378-6172-464b-97ac-02905593caf8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ba86a-d916-4858-a9fc-3e96218155ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ba86a-d916-4858-a9fc-3e96218155ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5b8e64-f307-4a39-9600-6a190134d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:06 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume b5b3a378-6172-464b-97ac-02905593caf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b3a378-6172-464b-97ac-02905593caf8', 'volume_size': 1} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1432687943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b3a378-6172-464b-97ac-02905593caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a8c78d9a7149dbb855256df71d69ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:06Z,use_quota=True,user_id='9ffe22f2f53f4821bdb920cb255ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Creating volume b5b3a378-6172-464b-97ac-02905593caf8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:52:06 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:06 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 1073741824 Apr 30 10:52:06 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:06 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.813s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:52:07 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 1073741824" returned: 0 in 1.368s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:07 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 Apr 30 10:52:07 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:08 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5b8e64-f307-4a39-9600-6a190134d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b3a378-6172-464b-97ac-02905593caf8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb76b494-ae52-4c60-832a-439cbffa558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Volume volume-b5b3a378-6172-464b-97ac-02905593caf8 (b5b3a378-6172-464b-97ac-02905593caf8): created successfully Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb76b494-ae52-4c60-832a-439cbffa558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Flow 'volume_create_manager' (e0dd3e57-e4f4-41ae-9b6a-caa15688fb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fc9777c8-303b-4f5e-8844-ef7c82eea1f6 tempest-TaggedBootDevicesTest_v242-1737659932 None] Created volume successfully. Apr 30 10:52:18 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:52:18 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-90a0da92-b395-4e7c-8a1e-0ec30c52deb2-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-90a0da92-b395-4e7c-8a1e-0ec30c52deb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-quobyte-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728505f-646b-4dce-8c6e-7776315655c6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:21 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 Apr 30 10:52:21 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:22 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" returned: 0 in 1.038s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:22 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2 Apr 30 10:52:22 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:23 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" returned: 0 in 0.844s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-90a0da92-b395-4e7c-8a1e-0ec30c52deb2" released by "delete_volume" :: held 1.942s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Created reservations ['8e04391b-40c3-4ae6-a2c3-437a498c5785', '2fea1c3a-924b-4518-929b-1e32317b1d77', '1f39db04-b042-44f2-b654-e40cef6d40b0', 'eb340e44-1075-4ddf-a12a-573822cab0c4'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:23 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:52:23 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:24 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.865s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:52:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Deleted volume successfully. Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-046342a8-0098-4af4-bbdf-50021fe74eba tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-90a0da92-b395-4e7c-8a1e-0ec30c52deb2-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-aa4dbbfb-7fa6-4019-9327-b4e68ace491c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-aa4dbbfb-7fa6-4019-9327-b4e68ace491c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-quobyte-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78adfd2-275b-4b6e-85db-0fd17b4088c7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:24 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c Apr 30 10:52:24 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:25 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" returned: 0 in 0.765s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:25 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c Apr 30 10:52:25 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:26 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-aa4dbbfb-7fa6-4019-9327-b4e68ace491c" released by "delete_volume" :: held 1.547s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Created reservations ['f4192a40-8ec2-4f19-813b-d70a9a5eb538', '89efb489-0710-4a6b-b779-d539d7d56160', '55b05e0a-8a88-4890-992c-413e0fd5003e', '2474c966-0d07-4bbf-8f7a-48a437641a7a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:26 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:52:26 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-e05c697a-eafd-4c9f-a913-fd8ab54aa920-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-e05c697a-eafd-4c9f-a913-fd8ab54aa920-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "cinder-quobyte-e05c697a-eafd-4c9f-a913-fd8ab54aa920" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-e05c697a-eafd-4c9f-a913-fd8ab54aa920" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f549c-acaf-4dbe-8ffb-1342d71491d6]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:27 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.717s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:52:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Deleted volume successfully. Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-14d9190a-2290-48cc-a221-cfd83507da2f tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-aa4dbbfb-7fa6-4019-9327-b4e68ace491c-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:27 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:52:27 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:27 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 0.891s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:28 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:52:28 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:28 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 1 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:52:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:28 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920 Apr 30 10:52:28 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:29 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e05c697a-eafd-4c9f-a913-fd8ab54aa920" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-quobyte-e05c697a-eafd-4c9f-a913-fd8ab54aa920" released by "delete_volume" :: held 2.616s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Created reservations ['af1c297e-bba3-42c0-8d5d-1102869c26f9', '11f033d1-363d-48e8-b9d1-637df9b6d61f', 'd0380f48-6e04-49e5-bd51-915b95832428', '9f5e6d40-6988-44ec-b564-5a42b4097dee'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:29 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:52:29 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:30 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:30 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:52:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Deleted volume successfully. Apr 30 10:52:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9c70acdc-ffb3-4b5b-9518-65cbdc1d0951 tempest-TaggedBootDevicesTest-50121462 None] Lock "cinder-e05c697a-eafd-4c9f-a913-fd8ab54aa920-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:52:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[419517b3-49fb-420e-a880-fac439ce498e]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:42 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:52:42 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:43 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 1.158s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:43 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:52:43 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:44 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 1 in 1.082s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:52:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.312s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '970a3ef2-ab29-4b3b-a656-4691940a8155', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:52:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-917f4ed1-03a7-4284-b595-0c441f6db64e tempest-TaggedBootDevicesTest_v242-1737659932 None] attachment_update completed successfully. Apr 30 10:52:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[532ac3d2-50b1-4438-8e50-8291db4e587a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:46 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 Apr 30 10:52:46 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:47 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8" returned: 0 in 0.923s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-b5d20354-1e55-4950-aeca-b1f0832e45f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf69b633-da43-4abe-afa4-936e2d0fe905', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:52:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-c1e43db7-1172-44ab-b451-6e3843746d3f tempest-TaggedBootDevicesTest_v242-1737659932 None] attachment_update completed successfully. Apr 30 10:52:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d3846-2dbd-42db-a8f4-5ddbaf0d5a40]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:49 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 Apr 30 10:52:49 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:50 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" returned: 0 in 1.307s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.349s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.716s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd3d17-d042-4e26-a87b-4cc9c59ace1d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '837f571e-eb79-4cec-91ec-5d8aed1e38fa', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:52:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-8f7a1f3a-6300-4377-a781-1c631bcce392 req-901419b9-f89a-4caa-a571-7358193d76e6 tempest-TaggedAttachmentsTest-1174198043 None] attachment_update completed successfully. Apr 30 10:52:50 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 Apr 30 10:52:50 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:51 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8" returned: 0 in 1.253s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.290s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-b5b3a378-6172-464b-97ac-02905593caf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8a9e6de-8a32-458c-b083-2929dbbad129', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:52:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9f1dcc53-aad3-4fd8-9930-c22592d89138 req-715ca4c8-cd39-4ec1-99f6-d225d9e4512e tempest-TaggedBootDevicesTest_v242-1737659932 None] attachment_update completed successfully. Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Flow 'volume_create_manager' (99f14ae5-7fb2-4c5b-9913-f1598df47429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ed70f-a01d-41b4-a9ff-01f0a21972a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ed70f-a01d-41b4-a9ff-01f0a21972a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1800275766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa6c46f-a5d5-482b-8d0a-02d72d420abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8addadd0c4f5405e8f3078e0940fb48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:54Z,use_quota=True,user_id='e5bacee100394a5991d78cec0639334b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c888be68-cc03-4ca9-bb7e-bec9cff211bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c888be68-cc03-4ca9-bb7e-bec9cff211bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802d917a-9d2b-4435-9a28-c4fef97ea874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802d917a-9d2b-4435-9a28-c4fef97ea874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa6c46f-a5d5-482b-8d0a-02d72d420abd', 'volume_name': 'volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caf19c9-c014-4d20-b2ec-1ca42945d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caf19c9-c014-4d20-b2ec-1ca42945d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c6560b-e45d-4032-8b6e-0c544c9a4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:53 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Volume efa6c46f-a5d5-482b-8d0a-02d72d420abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd', 'volume_size': 1} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1800275766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa6c46f-a5d5-482b-8d0a-02d72d420abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8addadd0c4f5405e8f3078e0940fb48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:52:54Z,use_quota=True,user_id='e5bacee100394a5991d78cec0639334b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Creating volume efa6c46f-a5d5-482b-8d0a-02d72d420abd {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:52:53 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:52:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:54 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd 1073741824 Apr 30 10:52:54 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:55 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd 1073741824" returned: 0 in 1.288s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:55 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd Apr 30 10:52:55 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:56 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd" returned: 0 in 1.218s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] <== create_volume: return (2574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.576s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c6560b-e45d-4032-8b6e-0c544c9a4695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657302c6-adb2-4b4f-b4af-6f9f9e332084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:52:56 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Volume volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd (efa6c46f-a5d5-482b-8d0a-02d72d420abd): created successfully Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657302c6-adb2-4b4f-b4af-6f9f9e332084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:52:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Flow 'volume_create_manager' (99f14ae5-7fb2-4c5b-9913-f1598df47429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:52:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-80076788-53ac-49a0-b58e-6a2509b22795 tempest-VolumesAdminNegativeTest-1309563530 None] Created volume successfully. Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Acquiring lock "cinder-efa6c46f-a5d5-482b-8d0a-02d72d420abd-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "cinder-efa6c46f-a5d5-482b-8d0a-02d72d420abd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Acquiring lock "cinder-quobyte-efa6c46f-a5d5-482b-8d0a-02d72d420abd" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "cinder-quobyte-efa6c46f-a5d5-482b-8d0a-02d72d420abd" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4249dc-2202-405f-a194-266b252dd51a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:52:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:57 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd Apr 30 10:52:57 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:58 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd" returned: 0 in 1.059s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:52:58 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd Apr 30 10:52:58 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:52:59 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 30 10:52:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efa6c46f-a5d5-482b-8d0a-02d72d420abd" returned: 0 in 1.055s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:52:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "cinder-quobyte-efa6c46f-a5d5-482b-8d0a-02d72d420abd" released by "delete_volume" :: held 2.183s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Created reservations ['537e3287-ad25-4a3f-8b22-d53110a8ea6e', '105dc6dd-ef86-4baa-a276-5b2a62441d27', 'ecda8569-e448-4b78-8d8c-3c02463f2d6d', '2a2bf148-7044-48c2-8812-5bf9e82afb72'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:53:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:00 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:53:00 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:01 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.089s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:53:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Deleted volume successfully. Apr 30 10:53:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c32a709-c107-4754-924e-529c0cece97f tempest-VolumesAdminNegativeTest-1309563530 None] Lock "cinder-efa6c46f-a5d5-482b-8d0a-02d72d420abd-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:53:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-22ae1cc0-0d08-4932-976a-6279795ae18d req-6087486e-1b2c-4244-bd1c-bdf14433fd1d tempest-TaggedAttachmentsTest-1174198043 None] Terminate volume connection completed successfully. Apr 30 10:53:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-22ae1cc0-0d08-4932-976a-6279795ae18d req-6087486e-1b2c-4244-bd1c-bdf14433fd1d tempest-TaggedAttachmentsTest-1174198043 None] Deleting attachment 837f571e-eb79-4cec-91ec-5d8aed1e38fa. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:06 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:53:06 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:06 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.624s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:53:11 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=43,cinder:INSERT=8,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:53:11 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=39,cinder:SELECT=48,cinder:INSERT=9,cinder:DELETE=3 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:53:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "cinder-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:53:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "cinder-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:53:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "cinder-quobyte-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:53:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "cinder-quobyte-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" acquired by "delete_volume" :: waited 0.033s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:53:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55371b2-2b45-4066-ab6f-7f2941ea5c41]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:53:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:21 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 Apr 30 10:53:21 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:22 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" returned: 0 in 1.303s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:22 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9 Apr 30 10:53:22 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:24 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" returned: 0 in 2.031s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "cinder-quobyte-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9" released by "delete_volume" :: held 3.440s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Created reservations ['db159b14-c9b3-4bbe-a66f-9e6f291f7b88', 'f539e3ca-a16b-495b-88cf-33a9188ce811', '722326ef-46b2-4aec-a53c-233f7be82802', '71ca6c84-6b04-4031-ba9f-6488010cf736'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:53:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:25 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:53:25 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:26 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.873s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:26 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:53:26 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Deleted volume successfully. Apr 30 10:53:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62549dce-5579-48b6-9291-a40e97eeac26 tempest-TaggedAttachmentsTest-1174198043 None] Lock "cinder-0eeb6e48-8d6b-446a-bc0e-a2cde30253e9-delete_volume" released by "delete_volume" :: held 5.890s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:53:34 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:53:36 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Flow 'volume_create_manager' (23685844-2608-4105-be63-8dcfa62d33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3398ab-c129-42b0-9386-76f7d872bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3398ab-c129-42b0-9386-76f7d872bc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:53:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b6b9b7-17ac-4cea-b68d-727955068ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029dd28694b84fddb65297bdbe12cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:53:54Z,use_quota=True,user_id='97e09bc9ab7b4bf48551f140a0323d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85f3f42-9178-4dad-b40f-f2eee752fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85f3f42-9178-4dad-b40f-f2eee752fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ce420d-e0ee-4ad9-a73e-0a61ec997ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.image.glance [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ce420d-e0ee-4ad9-a73e-0a61ec997ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8b6b9b7-17ac-4cea-b68d-727955068ffd', 'volume_name': 'volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f48c1b-7c77-46c6-bb61-4b29e02acfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f48c1b-7c77-46c6-bb61-4b29e02acfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73cb0fe-a1a0-4bbd-8743-01f50e8cc3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:53:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Volume f8b6b9b7-17ac-4cea-b68d-727955068ffd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 10:53:54 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Trying to clone f8b6b9b7-17ac-4cea-b68d-727955068ffd from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 10:53:55 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 10:53:55 devstack cinder-volume[84432]: INFO cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Image download 20.69 MB at 20.69 MB/s Apr 30 10:53:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5a9d3-0d11-4324-b19c-e27e8165a556]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:53:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:55 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD Apr 30 10:53:55 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:56 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD" returned: 0 in 1.009s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:56 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 97e09bc9ab7b4bf48551f140a0323d70. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 10:53:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08bde6e-0e4b-4bce-9ef6-17a19bef4d15]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:53:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:56 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD Apr 30 10:53:56 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:57 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:53:54Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b6b9b7-17ac-4cea-b68d-727955068ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029dd28694b84fddb65297bdbe12cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:53:54Z,use_quota=True,user_id='97e09bc9ab7b4bf48551f140a0323d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Creating volume f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:53:57 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:53:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:57 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1073741824 Apr 30 10:53:57 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:58 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1073741824" returned: 0 in 1.022s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:58 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:53:58 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:59 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 0.757s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume f8b6b9b7-17ac-4cea-b68d-727955068ffd. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b034f2e-55e1-4660-8e6c-c9b359af7c2a]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:53:59 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp Apr 30 10:53:59 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:53:59 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:53:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:00 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp Apr 30 10:54:00 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:00 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp" returned: 1 in 0.767s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_314y_jzp' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:54:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5b59a-170a-40bf-94b5-5ace1e6b2f06]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:00 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD Apr 30 10:54:00 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:01 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:01 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 10:54:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:01 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:01 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:04 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 2.637s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:04 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_2209urwhdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:54:04 devstack cinder-volume[84432]: INFO cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Converted 112.00 MB image at 42.44 MB/s Apr 30 10:54:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:04 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1G Apr 30 10:54:04 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:05 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd 1G" returned: 0 in 0.936s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2f109-9a38-4f2b-8e89-49bac583b88b]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:05 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:05 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:06 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:54:06 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:06 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 1.229s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:06 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:06 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:06 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.796s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Flow 'volume_create_manager' (ce3b8957-6c71-402b-ae0d-0278355f33cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6464b703-5fda-450e-b71e-40a2a237633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6464b703-5fda-450e-b71e-40a2a237633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-112379597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54e9768-5151-40ad-a0f6-0bee19739469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce804b041e846c4b1a17c1560d8200b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:54:07Z,use_quota=True,user_id='f5368e6aa1604f31920b19e2cca5eb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda86ecc-2afc-4989-8f1b-0f340a1065a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda86ecc-2afc-4989-8f1b-0f340a1065a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6f5c28-80f5-4f0d-9c93-f3b07473018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6f5c28-80f5-4f0d-9c93-f3b07473018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54e9768-5151-40ad-a0f6-0bee19739469', 'volume_name': 'volume-a54e9768-5151-40ad-a0f6-0bee19739469', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0768b9c8-4048-4cef-8a30-0e70b7c2a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0768b9c8-4048-4cef-8a30-0e70b7c2a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca32a32-1c06-411d-a0a1-c1273df8336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Volume a54e9768-5151-40ad-a0f6-0bee19739469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54e9768-5151-40ad-a0f6-0bee19739469', 'volume_size': 1} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-112379597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54e9768-5151-40ad-a0f6-0bee19739469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce804b041e846c4b1a17c1560d8200b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:54:07Z,use_quota=True,user_id='f5368e6aa1604f31920b19e2cca5eb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Creating volume a54e9768-5151-40ad-a0f6-0bee19739469 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:54:07 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 1 in 0.870s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume f8b6b9b7-17ac-4cea-b68d-727955068ffd successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 97e09bc9ab7b4bf48551f140a0323d70 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Marking volume f8b6b9b7-17ac-4cea-b68d-727955068ffd as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 10:54:07 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 1073741824 Apr 30 10:54:07 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to f8b6b9b7-17ac-4cea-b68d-727955068ffd. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Creating volume glance metadata for volume f8b6b9b7-17ac-4cea-b68d-727955068ffd backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73cb0fe-a1a0-4bbd-8743-01f50e8cc3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f8ab95-5627-4dd6-9660-421d1ca92829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Volume volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd (f8b6b9b7-17ac-4cea-b68d-727955068ffd): created successfully Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f8ab95-5627-4dd6-9660-421d1ca92829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Flow 'volume_create_manager' (23685844-2608-4105-be63-8dcfa62d33d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:54:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-519d00ed-9691-4fca-917d-9d2a55cec529 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Created volume successfully. Apr 30 10:54:08 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 1073741824" returned: 0 in 1.117s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:08 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 Apr 30 10:54:08 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:09 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469" returned: 0 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca32a32-1c06-411d-a0a1-c1273df8336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54e9768-5151-40ad-a0f6-0bee19739469', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe07ec5-24b4-4799-a0ee-a82ddf519138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:09 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Volume volume-a54e9768-5151-40ad-a0f6-0bee19739469 (a54e9768-5151-40ad-a0f6-0bee19739469): created successfully Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe07ec5-24b4-4799-a0ee-a82ddf519138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Flow 'volume_create_manager' (ce3b8957-6c71-402b-ae0d-0278355f33cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:54:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e9861db8-3af6-4c2f-aa6a-14585f470e93 tempest-ServerStableDeviceRescueTest-1025586702 None] Created volume successfully. Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85f88c-7934-479e-89b0-ced18a86c7aa]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:10 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:10 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:10 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 0.873s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:10 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:10 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:11 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 1 in 0.994s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:54:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.906s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad08f74e-d5ec-4352-a5d3-f5cf05bdad3c', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:54:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-7fd25869-5f5e-49fc-beae-9988dcda4e78 req-ace44fb7-3a3b-4d8f-b3e2-32c9b217f633 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] attachment_update completed successfully. Apr 30 10:54:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:54:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:INSERT=9 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:54:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-e2e42576-8125-4f5e-bec5-e9947c75e1b0 tempest-TaggedBootDevicesTest_v242-1737659932 None] Terminate volume connection completed successfully. Apr 30 10:54:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-e2e42576-8125-4f5e-bec5-e9947c75e1b0 tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleting attachment 970a3ef2-ab29-4b3b-a656-4691940a8155. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:54:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-28958a86-7e15-4b9e-938f-5ac217107098 tempest-TaggedBootDevicesTest_v242-1737659932 None] Terminate volume connection completed successfully. Apr 30 10:54:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-28958a86-7e15-4b9e-938f-5ac217107098 tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleting attachment bf69b633-da43-4abe-afa4-936e2d0fe905. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:54:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-05633087-6002-448b-bc96-687ae5612b9a tempest-TaggedBootDevicesTest_v242-1737659932 None] Terminate volume connection completed successfully. Apr 30 10:54:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-d22fc7ce-a65d-4e37-9ae6-496d282645fe req-05633087-6002-448b-bc96-687ae5612b9a tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleting attachment e8a9e6de-8a32-458c-b083-2929dbbad129. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:54:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-b5b3a378-6172-464b-97ac-02905593caf8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-b5b3a378-6172-464b-97ac-02905593caf8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-quobyte-b5b3a378-6172-464b-97ac-02905593caf8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-b5b3a378-6172-464b-97ac-02905593caf8" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[646cbb6a-dfae-49ce-9265-3a33e3bfa8a5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:37 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 Apr 30 10:54:37 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:37 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:37 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8 Apr 30 10:54:37 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:38 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5b3a378-6172-464b-97ac-02905593caf8" returned: 0 in 0.643s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-b5b3a378-6172-464b-97ac-02905593caf8" released by "delete_volume" :: held 1.421s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Created reservations ['0fb139b4-29e4-488e-85fd-42ba3bc07533', '119cd5ca-2e75-45ae-87fb-2f0c468d6101', '23fe8430-c3d5-40c9-a016-04faf79efd05', '95bd9bb0-7eae-4e1c-87f1-f58ed282f43c'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:38 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:54:38 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Flow 'volume_create_manager' (635fd8e4-a607-4f10-a9c7-bead024dd26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450cadf3-ad91-4504-b86a-76e0cf02b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450cadf3-ad91-4504-b86a-76e0cf02b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1009803096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124db91e-e734-470d-9703-f9f1129197f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562b70b193ec402bb75454122cf15fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:54:39Z,use_quota=True,user_id='2f2710793dab4c7eafb8237fa4d825af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190253b8-0c7e-491b-ac20-b79850c7010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190253b8-0c7e-491b-ac20-b79850c7010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc788e5-a342-4ef3-96d2-e204a949bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc788e5-a342-4ef3-96d2-e204a949bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124db91e-e734-470d-9703-f9f1129197f9', 'volume_name': 'volume-124db91e-e734-470d-9703-f9f1129197f9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03fb8c6-e5e7-4a53-84cb-d1f5c9c0589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03fb8c6-e5e7-4a53-84cb-d1f5c9c0589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5592524d-45d5-4372-8887-7b0739c69716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:39 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Volume 124db91e-e734-470d-9703-f9f1129197f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124db91e-e734-470d-9703-f9f1129197f9', 'volume_size': 1} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1009803096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124db91e-e734-470d-9703-f9f1129197f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562b70b193ec402bb75454122cf15fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:54:39Z,use_quota=True,user_id='2f2710793dab4c7eafb8237fa4d825af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Creating volume 124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:54:39 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:39 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 1073741824 Apr 30 10:54:39 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-b5d20354-1e55-4950-aeca-b1f0832e45f8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-b5d20354-1e55-4950-aeca-b1f0832e45f8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-quobyte-b5d20354-1e55-4950-aeca-b1f0832e45f8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-b5d20354-1e55-4950-aeca-b1f0832e45f8" acquired by "delete_volume" :: waited 0.089s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:39 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.188s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f337e5e-0772-4195-908f-c617877703b0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleted volume successfully. Apr 30 10:54:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8ce3ca1f-7334-46af-a657-34b36c3f99dc tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-b5b3a378-6172-464b-97ac-02905593caf8-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:40 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 Apr 30 10:54:40 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:41 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 1073741824" returned: 0 in 2.051s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:41 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 Apr 30 10:54:41 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:41 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8" returned: 0 in 1.734s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:41 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8 Apr 30 10:54:41 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:43 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5d20354-1e55-4950-aeca-b1f0832e45f8" returned: 0 in 1.675s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-b5d20354-1e55-4950-aeca-b1f0832e45f8" released by "delete_volume" :: held 3.541s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:43 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9" returned: 0 in 1.935s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] <== create_volume: return (4108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.113s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5592524d-45d5-4372-8887-7b0739c69716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124db91e-e734-470d-9703-f9f1129197f9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77768a38-a9eb-4b9a-9e04-fd9d1cdf8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:54:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Volume volume-124db91e-e734-470d-9703-f9f1129197f9 (124db91e-e734-470d-9703-f9f1129197f9): created successfully Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77768a38-a9eb-4b9a-9e04-fd9d1cdf8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Flow 'volume_create_manager' (635fd8e4-a607-4f10-a9c7-bead024dd26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Created reservations ['79a931db-5f06-4bb6-a7d9-c1d914522b8f', 'd2e1f64a-2dc6-4b67-bf85-c7e2f0ef023e', 'e6b5431f-986d-4760-9879-0e4696d65215', 'e76edabb-bbec-4064-b134-948b92e8c390'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:54:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-85efbc6b-afc0-4dd0-9db9-d0e059068847 tempest-ServerActionsTestOtherA-375208199 None] Created volume successfully. Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:43 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:54:43 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "cinder-quobyte-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" acquired by "delete_volume" :: waited 0.052s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c2cce-a26d-4224-b482-3afbb4b1ca17]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:44 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:54:44 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:45 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.365s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:45 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:54:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleted volume successfully. Apr 30 10:54:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5fa1c4e7-78e8-4db9-b164-8a4f63452af2 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-b5d20354-1e55-4950-aeca-b1f0832e45f8-delete_volume" released by "delete_volume" :: held 5.659s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:45 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 0.889s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:45 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:54:45 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:46 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 1 in 0.955s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:54:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:46 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66 Apr 30 10:54:46 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:47 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-quobyte-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66" released by "delete_volume" :: held 2.784s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Created reservations ['ab790102-a7a0-4940-8fae-78fe1ef927ec', '21cdd5e2-58ff-4765-bd7c-b6b1a94a7d70', '13c36a58-d386-4df3-8a70-5e771daaac81', '2857e89f-2071-4c9b-b560-3567b2517e27'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:54:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:47 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:54:47 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:48 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.953s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:54:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Deleted volume successfully. Apr 30 10:54:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3b0b5e95-3489-4571-a892-eb1820b417a9 tempest-TaggedBootDevicesTest_v242-1737659932 None] Lock "cinder-5f21278c-ce0e-4c50-bb6e-2239ba2e6f66-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:54:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4f4f1ce4-1a36-45ff-9247-c5802015e6d4 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Terminate volume connection completed successfully. Apr 30 10:54:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4f4f1ce4-1a36-45ff-9247-c5802015e6d4 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Deleting attachment ad08f74e-d5ec-4352-a5d3-f5cf05bdad3c. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "cinder-f8b6b9b7-17ac-4cea-b68d-727955068ffd-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "cinder-f8b6b9b7-17ac-4cea-b68d-727955068ffd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "cinder-quobyte-f8b6b9b7-17ac-4cea-b68d-727955068ffd" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "cinder-quobyte-f8b6b9b7-17ac-4cea-b68d-727955068ffd" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a567b0c7-accf-4c8e-903d-5f3e5574884d]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:54:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:57 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:57 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:58 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 1.025s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:58 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:58 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:54:59 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 30 10:54:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 1 in 0.867s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:54:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:54:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:54:59 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd Apr 30 10:54:59 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:00 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8b6b9b7-17ac-4cea-b68d-727955068ffd" returned: 0 in 1.107s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "cinder-quobyte-f8b6b9b7-17ac-4cea-b68d-727955068ffd" released by "delete_volume" :: held 3.098s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG cinder.quota [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Created reservations ['fdada686-9626-4baa-9442-c840aa662bd9', '79932116-1a8a-4261-a98f-1bf5eb9e29ba', 'ae6a6838-a33e-4cfa-a74c-cab7d911060c', 'bc3ff2fe-45be-4715-ac7e-fac50910fa94'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:00 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:55:00 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:01 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:01 devstack cinder-volume[84432]: DEBUG cinder.manager [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:55:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Deleted volume successfully. Apr 30 10:55:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-5cf7217e-68eb-4997-a858-5015f7289329 req-4107b2d8-f259-4ceb-bcbe-f009e68f6198 tempest-ServerBootFromVolumeStableRescueTest-350380460 None] Lock "cinder-f8b6b9b7-17ac-4cea-b68d-727955068ffd-delete_volume" released by "delete_volume" :: held 4.297s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:06 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:55:06 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:07 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.270s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:55:10 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:55:11 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:55:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89f401-ec74-4b4f-a177-c65705a3f7cb]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:12 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 Apr 30 10:55:12 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:13 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469" returned: 0 in 1.120s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.150s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-a54e9768-5151-40ad-a0f6-0bee19739469', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98f71f78-766f-43f1-90cf-e041491b8ccd', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:55:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-80327516-37cb-408b-af0d-d9bf1f8f2bfd req-bdf49475-05a9-4ce4-9561-cdd5ae2cb46f tempest-ServerStableDeviceRescueTest-1025586702 None] attachment_update completed successfully. Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Flow 'volume_create_manager' (19266a55-28df-46e8-b5e7-91d3c0dbd173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95c3c1d-e6f2-4a75-93fa-cdb73c578dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95c3c1d-e6f2-4a75-93fa-cdb73c578dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-69234346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114d7c5409894c29857d6c266e075521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:55:19Z,use_quota=True,user_id='ab84bbdd4a5d4831a49c2db1df81c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e93750a-d0f2-4e0b-8252-ea34d25469a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e93750a-d0f2-4e0b-8252-ea34d25469a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9945b96d-3c98-41f6-ba84-438f1e8245c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:18 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9945b96d-3c98-41f6-ba84-438f1e8245c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'volume_name': 'volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc496238-c298-4340-b7c4-862a1dc2851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc496238-c298-4340-b7c4-862a1dc2851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd1535-b58c-4d5e-bcad-210748ad1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Trying to clone e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 10:55:19 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Image download 20.69 MB at 20.69 MB/s Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe083abc-4b59-4a5a-a4be-8ae76660a514]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:20 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD Apr 30 10:55:20 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:20 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:20 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user ab84bbdd4a5d4831a49c2db1df81c484. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 10:55:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1eb8c-36b1-46ce-bac6-3eb53804f9a2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:20 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD Apr 30 10:55:20 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:21 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-69234346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114d7c5409894c29857d6c266e075521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:55:19Z,use_quota=True,user_id='ab84bbdd4a5d4831a49c2db1df81c484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Creating volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:55:21 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:55:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:21 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1073741824 Apr 30 10:55:21 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:22 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1073741824" returned: 0 in 0.869s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:22 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:22 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:23 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 0.905s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c9c4e-f008-4468-846d-e94b9e41ec63]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:23 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r Apr 30 10:55:23 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:24 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:24 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r Apr 30 10:55:24 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:24 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r" returned: 1 in 0.725s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_9fpr0i3r' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaebcd4-a0d6-4945-ba58-28cc6215b0e5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:25 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD Apr 30 10:55:25 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:25 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD" returned: 0 in 0.968s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:25 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 10:55:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:25 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:25 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:28 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 2.386s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:28 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_mzycydridevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:55:28 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Converted 112.00 MB image at 46.91 MB/s Apr 30 10:55:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:28 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G Apr 30 10:55:28 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:29 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G" returned: 0 in 0.811s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:29 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb69f9b-c896-4f34-9992-8d2e826c4017]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:29 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:29 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:30 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 0.932s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:30 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:30 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:30 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 1 in 0.813s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user ab84bbdd4a5d4831a49c2db1df81c484 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 10:55:30 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Marking volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Creating volume glance metadata for volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd1535-b58c-4d5e-bcad-210748ad1291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81643a10-0fac-40d2-844d-3304ef410a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:55:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Volume volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d (e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d): created successfully Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81643a10-0fac-40d2-844d-3304ef410a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Flow 'volume_create_manager' (19266a55-28df-46e8-b5e7-91d3c0dbd173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:55:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-eb5d1986-23bb-4728-9035-49e9c00531d7 tempest-ServerActionsV293TestJSON-1681192201 None] Created volume successfully. Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f83c3b-7885-44d8-aa5e-48a25de607bc]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:31 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 Apr 30 10:55:31 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:32 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9" returned: 0 in 0.996s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-124db91e-e734-470d-9703-f9f1129197f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '778539ed-14ae-4fab-a6ab-10fcb0a704d0', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:55:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-82624789-fac3-4f0c-9798-39a310d32b1e req-c3e635aa-180a-42cc-8004-ab7077f68904 tempest-ServerActionsTestOtherA-375208199 None] attachment_update completed successfully. Apr 30 10:55:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5774e-93ce-4f47-93f5-63fada44dde1]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:40 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:40 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-816fa1f7-f3b0-4712-a894-296bc09c21e2 tempest-ServerActionsTestOtherA-375208199 None] Terminate volume connection completed successfully. Apr 30 10:55:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-816fa1f7-f3b0-4712-a894-296bc09c21e2 tempest-ServerActionsTestOtherA-375208199 None] Deleting attachment 778539ed-14ae-4fab-a6ab-10fcb0a704d0. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:55:42 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 1.708s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:42 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:55:42 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:43 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 1 in 1.518s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:55:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.281s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '824f8507-43d3-488a-99dc-27eb1f58990f', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:55:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-de045ad4-282a-44d8-8f2d-821c853e7896 req-328a7cc9-13eb-43c6-a6fc-93b8958ef87e tempest-ServerActionsV293TestJSON-1681192201 None] attachment_update completed successfully. Apr 30 10:55:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:55:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:55:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5631c-7a39-46f5-ac88-52379dbe8bcb]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:55:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:55:45 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 Apr 30 10:55:45 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:55:45 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Apr 30 10:55:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9" returned: 0 in 0.793s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:55:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:55:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-124db91e-e734-470d-9703-f9f1129197f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12d944e0-57b8-4bdf-8d20-caa90cda8508', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:55:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-32684587-7eed-4ced-88e1-b4ca5c9525c5 req-a0db8139-166a-4edb-a806-813acc0b313d tempest-ServerActionsTestOtherA-375208199 None] attachment_update completed successfully. Apr 30 10:55:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=36,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:55:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=29,cinder:UPDATE=12,cinder:INSERT=11 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:06 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:56:06 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:06 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.581s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:56:14 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-a52d9f98-e176-43bb-bd22-32885383ba07 req-742f8d63-01da-4d46-a910-0fbc6acb3e82 tempest-ServerStableDeviceRescueTest-1025586702 None] Terminate volume connection completed successfully. Apr 30 10:56:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-a52d9f98-e176-43bb-bd22-32885383ba07 req-742f8d63-01da-4d46-a910-0fbc6acb3e82 tempest-ServerStableDeviceRescueTest-1025586702 None] Deleting attachment 98f71f78-766f-43f1-90cf-e041491b8ccd. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (fc3d136a-2c0c-4242-a429-90487cf21271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c3d3d6-4517-4d60-a0d8-6c019f956c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c3d3d6-4517-4d60-a0d8-6c019f956c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389799676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299ab4ee-db4d-46d9-a9a2-08405379e20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:56:19Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d250e22-3417-4ff7-bdc0-ca8b94dd1d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d250e22-3417-4ff7-bdc0-ca8b94dd1d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bda4c0-f147-4542-b349-b3aac61176ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bda4c0-f147-4542-b349-b3aac61176ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299ab4ee-db4d-46d9-a9a2-08405379e20b', 'volume_name': 'volume-299ab4ee-db4d-46d9-a9a2-08405379e20b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342017dd-fd2a-45bf-bdcd-07d8ec561b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342017dd-fd2a-45bf-bdcd-07d8ec561b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc91da8-7533-4e01-8795-5b672125de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Volume 299ab4ee-db4d-46d9-a9a2-08405379e20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299ab4ee-db4d-46d9-a9a2-08405379e20b', 'volume_size': 1} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389799676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299ab4ee-db4d-46d9-a9a2-08405379e20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:56:19Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Creating volume 299ab4ee-db4d-46d9-a9a2-08405379e20b {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:56:19 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:56:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:19 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b 1073741824 Apr 30 10:56:19 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:20 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b 1073741824" returned: 0 in 0.962s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:20 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b Apr 30 10:56:20 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:21 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc91da8-7533-4e01-8795-5b672125de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299ab4ee-db4d-46d9-a9a2-08405379e20b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd5e49b-19b9-4262-ab63-2f564946d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:56:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Volume volume-299ab4ee-db4d-46d9-a9a2-08405379e20b (299ab4ee-db4d-46d9-a9a2-08405379e20b): created successfully Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd5e49b-19b9-4262-ab63-2f564946d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:56:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (fc3d136a-2c0c-4242-a429-90487cf21271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:56:21 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9bedb10d-2a23-4274-908e-0c1e14221bb5 tempest-AttachVolumeTestJSON-686146806 None] Created volume successfully. Apr 30 10:56:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-6fe9c5de-4af7-42bf-a6e3-c1fa3e132757 req-bd0714cb-daf2-4bfa-8288-0c717489ffd2 tempest-ServerActionsTestOtherA-375208199 None] Terminate volume connection completed successfully. Apr 30 10:56:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-6fe9c5de-4af7-42bf-a6e3-c1fa3e132757 req-bd0714cb-daf2-4bfa-8288-0c717489ffd2 tempest-ServerActionsTestOtherA-375208199 None] Deleting attachment 12d944e0-57b8-4bdf-8d20-caa90cda8508. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "cinder-a54e9768-5151-40ad-a0f6-0bee19739469-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "cinder-a54e9768-5151-40ad-a0f6-0bee19739469-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "cinder-quobyte-a54e9768-5151-40ad-a0f6-0bee19739469" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "cinder-quobyte-a54e9768-5151-40ad-a0f6-0bee19739469" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c33ec-3b60-43de-8757-af0b24df8b9c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:24 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 Apr 30 10:56:24 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e91040-2038-4a17-a658-3519d8367da9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:25 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b Apr 30 10:56:25 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:25 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469" returned: 0 in 0.734s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:25 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469 Apr 30 10:56:25 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:25 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b" returned: 0 in 0.767s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-299ab4ee-db4d-46d9-a9a2-08405379e20b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc89e950-5b51-476b-8191-bff71e68eee2', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:56:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-6fee8acd-26a6-4a48-abba-fc07ac2a9ad9 req-5189e326-f90b-46ef-8cde-3ef3c867f562 tempest-AttachVolumeTestJSON-686146806 None] attachment_update completed successfully. Apr 30 10:56:26 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a54e9768-5151-40ad-a0f6-0bee19739469" returned: 0 in 0.676s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "cinder-quobyte-a54e9768-5151-40ad-a0f6-0bee19739469" released by "delete_volume" :: held 1.450s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Created reservations ['2e9dc5d0-ada5-4fe5-a1e7-e3836908fab9', 'c02477ca-33d9-46f0-be04-ee392d206e78', '0c72a4d4-d9d5-4adb-a155-9d8e1763ccce', '3d5ab42d-cfbd-49f1-9396-4dba3d82dc54'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:26 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:56:26 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:27 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.732s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:27 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:56:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Deleted volume successfully. Apr 30 10:56:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8bfd260-c9a7-46ca-8caf-ceac566dafd8 tempest-ServerStableDeviceRescueTest-1025586702 None] Lock "cinder-a54e9768-5151-40ad-a0f6-0bee19739469-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "cinder-124db91e-e734-470d-9703-f9f1129197f9-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "cinder-124db91e-e734-470d-9703-f9f1129197f9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "cinder-quobyte-124db91e-e734-470d-9703-f9f1129197f9" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "cinder-quobyte-124db91e-e734-470d-9703-f9f1129197f9" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf63217-997e-4262-b3c2-cd8fbf6d8d53]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:33 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 Apr 30 10:56:33 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:34 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9" returned: 0 in 0.739s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:34 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9 Apr 30 10:56:34 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:34 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-124db91e-e734-470d-9703-f9f1129197f9" returned: 0 in 0.685s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "cinder-quobyte-124db91e-e734-470d-9703-f9f1129197f9" released by "delete_volume" :: held 1.491s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Created reservations ['86530249-2320-4a70-beb6-0d7b8db64cd0', 'd8f0454f-f51c-47bd-bcbf-d9fde5bfcd8e', '8935e9a5-aae3-45ad-bfe7-adf828340c1b', '629f5aa1-14fe-49c8-953a-73eb025326a2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:35 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:56:35 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:35 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.821s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:56:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Deleted volume successfully. Apr 30 10:56:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a87a3c8d-924a-4161-87c7-5601eb077ed9 tempest-ServerActionsTestOtherA-375208199 None] Lock "cinder-124db91e-e734-470d-9703-f9f1129197f9-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:56:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-263d90fb-a656-4082-b88d-7ab02ac56c6f tempest-ServerActionsV293TestJSON-1681192201 None] Terminate volume connection completed successfully. Apr 30 10:56:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-263d90fb-a656-4082-b88d-7ab02ac56c6f tempest-ServerActionsV293TestJSON-1681192201 None] Deleting attachment 824f8507-43d3-488a-99dc-27eb1f58990f. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:56:40 devstack cinder-volume[84432]: DEBUG cinder.image.glance [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 10:56:40 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 10:56:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb6221-acc5-454e-b3c5-0a019027ca6a]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:40 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 Apr 30 10:56:40 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:41 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1" returned: 0 in 0.844s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:41 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 Apr 30 10:56:41 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:42 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1" returned: 1 in 0.844s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:56:42 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 10:56:42 devstack cinder-volume[84432]: INFO cinder.image.image_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Image download 20.69 MB at 20.69 MB/s Apr 30 10:56:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7eafb3-7f68-4259-bf99-c34bcdccccd5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:43 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 Apr 30 10:56:43 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:44 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1" returned: 0 in 1.115s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:44 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 10:56:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:44 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:56:44 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:44 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:56:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:56:49 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 5.493s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:49 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_xevugis1, size 112.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:56:49 devstack cinder-volume[84432]: INFO cinder.image.image_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Converted 112.00 MB image at 20.39 MB/s Apr 30 10:56:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:49 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G Apr 30 10:56:49 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:50 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d 1G" returned: 0 in 0.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899ca0d-ed3e-4e9c-b85c-81d7d869cc21]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:50 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:56:50 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:51 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 1.018s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:51 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:56:51 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:52 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 1 in 1.152s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Marking volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Creating volume glance metadata for volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5408}} Apr 30 10:56:52 devstack cinder-volume[84432]: DEBUG cinder.compute.nova [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Creating Keystone auth plugin from conf {{(pid=84432) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Apr 30 10:56:53 devstack cinder-volume[84432]: DEBUG novaclient.v2.client [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] REQ: curl -g -i -X POST http://192.168.122.163/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}dbbf00754c84d65043c0b61d0287e3026b99b46e4f29e7c306652119fa698b03" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-49cf249d-f86c-44ff-831a-4497626bf20a" -H "X-Service-Token: {SHA256}f84ac27ca9d245f15431af0c4724619fd2f4c6c4cad19b43399bf8ca656305df" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "5e120970-360d-4e94-9495-716ccf3edfe0", "tag": "e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d"}]}' {{(pid=84432) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Apr 30 10:56:53 devstack cinder-volume[84432]: DEBUG novaclient.v2.client [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 30 Apr 2026 08:56:53 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-b1bd249d-9f01-45e4-8d8a-a76f0354626c x-openstack-request-id: req-b1bd249d-9f01-45e4-8d8a-a76f0354626c {{(pid=84432) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Apr 30 10:56:53 devstack cinder-volume[84432]: DEBUG novaclient.v2.client [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "5e120970-360d-4e94-9495-716ccf3edfe0", "tag": "e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d", "status": "completed", "code": 200}]} {{(pid=84432) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Apr 30 10:56:53 devstack cinder-volume[84432]: DEBUG novaclient.v2.client [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] POST call to compute for http://192.168.122.163/compute/v2.1/os-server-external-events used request id req-b1bd249d-9f01-45e4-8d8a-a76f0354626c {{(pid=84432) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Apr 30 10:56:53 devstack cinder-volume[84432]: INFO cinder.compute.nova [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': '5e120970-360d-4e94-9495-716ccf3edfe0', 'tag': 'e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'status': 'completed', 'code': 200}. Apr 30 10:56:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-da619ff5-f8ac-44ec-adaa-03c305970c40 tempest-ServerActionsV293TestJSON-1681192201 None] Re-imaged 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to volume e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d successfully. {{(pid=84432) reimage /opt/stack/cinder/cinder/volume/manager.py:5451}} Apr 30 10:56:54 devstack cinder-volume[84432]: DEBUG oslo_db.sqlalchemy.engines [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 10:56:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:56:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:56:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b35c81-0f39-455a-8e56-7ea07094afd0]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:56:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:55 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:56:55 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:55 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 0.990s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:56:56 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:56:56 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:56:56 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Apr 30 10:56:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 1 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:56:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:56:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.975s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:56:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38dd52f8-2bc9-4021-9795-b0d599b8d0d2', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:56:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-49cf249d-f86c-44ff-831a-4497626bf20a req-e83279d3-7b1d-4645-954f-6efd0c3ea23a tempest-ServerActionsV293TestJSON-1681192201 None] attachment_update completed successfully. Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:57:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:06 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:57:06 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:07 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=3,cinder:SELECT=12,cinder:INSERT=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:07 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=3,cinder:SELECT=12,cinder:INSERT=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:07 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.369s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:57:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-5e134009-d36f-4386-8bbd-75d358df1e12 req-b058c442-c3e3-4ec2-858c-aafda972573a tempest-AttachVolumeTestJSON-686146806 None] Terminate volume connection completed successfully. Apr 30 10:57:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-5e134009-d36f-4386-8bbd-75d358df1e12 req-b058c442-c3e3-4ec2-858c-aafda972573a tempest-AttachVolumeTestJSON-686146806 None] Deleting attachment fc89e950-5b51-476b-8191-bff71e68eee2. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:57:21 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:21 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Flow 'volume_create_manager' (d5dacb54-945c-47a0-8e35-172340a61873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60e3c8b-553d-430a-97b4-f0c659f4604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60e3c8b-553d-430a-97b4-f0c659f4604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-317991350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684d86d77fca45e09f5f6063d329b78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:57:36Z,use_quota=True,user_id='fec2482ac1bf4f19bc7dddde3659576d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164fc2c-5e6e-42b7-a6db-579d76487783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164fc2c-5e6e-42b7-a6db-579d76487783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879cec20-eabe-436a-b644-68a8b2584bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879cec20-eabe-436a-b644-68a8b2584bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11', 'volume_name': 'volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac82f35-9eea-4c68-84e6-eddfb5c30cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac82f35-9eea-4c68-84e6-eddfb5c30cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddad3ac-da0d-429d-a6fe-839eecf80ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Volume 64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11', 'volume_size': 1} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-317991350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684d86d77fca45e09f5f6063d329b78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:57:36Z,use_quota=True,user_id='fec2482ac1bf4f19bc7dddde3659576d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Creating volume 64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:57:36 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:57:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:36 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 1073741824 Apr 30 10:57:36 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:37 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 1073741824" returned: 0 in 1.208s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:37 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 Apr 30 10:57:37 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:38 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddad3ac-da0d-429d-a6fe-839eecf80ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a55c8a-58d2-4bfa-b4fa-0f6e0161a6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:57:38 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Volume volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 (64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11): created successfully Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a55c8a-58d2-4bfa-b4fa-0f6e0161a6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:57:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Flow 'volume_create_manager' (d5dacb54-945c-47a0-8e35-172340a61873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:57:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4bdea97b-deb7-40cc-a843-a3b6f27342e1 tempest-ServerRescueNegativeTestJSON-315325233 None] Created volume successfully. Apr 30 10:57:48 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:48 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:57:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-0fd4ebec-4b12-40d6-83aa-59aedb57fb6b tempest-ServerActionsV293TestJSON-1681192201 None] Terminate volume connection completed successfully. Apr 30 10:57:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-0fd4ebec-4b12-40d6-83aa-59aedb57fb6b tempest-ServerActionsV293TestJSON-1681192201 None] Deleting attachment 38dd52f8-2bc9-4021-9795-b0d599b8d0d2. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "cinder-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "cinder-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "cinder-quobyte-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "cinder-quobyte-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f31f2-8438-4a57-b540-7c0b61b19865]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:57:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:50 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:57:50 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:51 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 1.226s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:52 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:57:52 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:52 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 1 in 0.926s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 10:57:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:52 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d Apr 30 10:57:52 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:53 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" returned: 0 in 0.868s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "cinder-quobyte-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d" released by "delete_volume" :: held 3.175s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG cinder.quota [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Created reservations ['abdb0d76-75f5-4402-ad15-2446317b0ff8', '7251471d-31a5-45fe-81c8-6f9bdf80ea72', '9227820a-c875-415e-b569-42d91c9e20db', '32d038b7-eb9d-4762-96f4-6283f97ec613'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:57:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:53 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:57:53 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:57:54 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Apr 30 10:57:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:57:54 devstack cinder-volume[84432]: DEBUG cinder.manager [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:57:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Deleted volume successfully. Apr 30 10:57:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-fcd5d32c-f6e3-43e7-a779-6a23fdd6d49a req-986c16d9-1e86-40ce-b478-4022eaa2b971 tempest-ServerActionsV293TestJSON-1681192201 None] Lock "cinder-e78e8b1e-6f92-4c26-8fb2-e7766e35ca2d-delete_volume" released by "delete_volume" :: held 4.278s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Acquiring lock "cinder-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "cinder-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Acquiring lock "cinder-quobyte-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "cinder-quobyte-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" acquired by "delete_volume" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b128e-d87b-4c1e-a5a7-3aa5a88aa20b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:57:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:57:59 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 Apr 30 10:57:59 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:00 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" returned: 0 in 1.531s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:00 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11 Apr 30 10:58:00 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:01 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "cinder-quobyte-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11" released by "delete_volume" :: held 2.402s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Created reservations ['2a7374b4-05f8-4e3b-8845-7784bbaf6cf9', 'e187ded4-c04f-4431-861f-c56d1d4da6e9', '7d444501-72d0-4398-9be8-84369374db38', '5421036f-2c91-450a-9b6c-94e77971d328'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:01 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:58:01 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Flow 'volume_create_manager' (3e26cc36-40d4-4161-bc41-47ef0df7bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f70aa3a-7c9e-4f5f-b99b-2240be7c5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f70aa3a-7c9e-4f5f-b99b-2240be7c5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-2128338811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e5c8f1-9fa2-4b20-9096-7da5a2b6697e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0d67398e824e4588f5b3777e7adb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:02Z,use_quota=True,user_id='164298d12ac04bb9aa8f4791a7287227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee710b7-8994-446d-92b9-27e1a3e2aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee710b7-8994-446d-92b9-27e1a3e2aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb0a970-7f59-46b1-a973-9b17305263a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb0a970-7f59-46b1-a973-9b17305263a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'volume_name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc154a45-2ff5-4944-8e5d-405d60355cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc154a45-2ff5-4944-8e5d-405d60355cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f68eab-7b8f-459e-8c7f-dcbf658b5d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Volume 32e5c8f1-9fa2-4b20-9096-7da5a2b6697e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'volume_size': 1} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-2128338811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e5c8f1-9fa2-4b20-9096-7da5a2b6697e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0d67398e824e4588f5b3777e7adb3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:02Z,use_quota=True,user_id='164298d12ac04bb9aa8f4791a7287227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Creating volume 32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:58:02 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:58:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:02 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e 1073741824 Apr 30 10:58:02 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:03 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.723s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:03 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:58:03 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Deleted volume successfully. Apr 30 10:58:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bf6fb98a-119a-472b-9cdc-8129b19d0424 tempest-ServerRescueNegativeTestJSON-315325233 None] Lock "cinder-64edc4ff-7330-4baa-8c0a-9b7a8e9c6c11-delete_volume" released by "delete_volume" :: held 4.726s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:04 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e 1073741824" returned: 0 in 1.961s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:04 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:58:04 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:05 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 1.046s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] <== create_volume: return (3174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.178s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f68eab-7b8f-459e-8c7f-dcbf658b5d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f2e6f2-9581-46ab-a53f-31f3756774ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:05 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Volume volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e (32e5c8f1-9fa2-4b20-9096-7da5a2b6697e): created successfully Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f2e6f2-9581-46ab-a53f-31f3756774ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Flow 'volume_create_manager' (3e26cc36-40d4-4161-bc41-47ef0df7bde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-72352ba0-2052-4354-a718-b1128ccfed4f tempest-ServerActionsTestOtherB-693036907 None] Created volume successfully. Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:06 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:58:06 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:07 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.116s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:58:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a0b33e-8c99-4d8a-93c3-0986d39993c7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:11 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:58:11 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:12 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 0.877s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e93357a8-a360-4758-a94d-627414c3e9ea', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:58:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-0d33c4b3-790f-4e53-b728-d5c34cc0a9be req-fce79afa-3e8e-4ea2-bebd-dc0aeafe3849 tempest-ServerActionsTestOtherB-693036907 None] attachment_update completed successfully. Apr 30 10:58:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-207f94e5-247f-4dd3-8477-f62770c409fc tempest-GroupsV320Test-676970992 None] Group tempest-GroupsV320Test-Group-1383700297: creating Apr 30 10:58:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-207f94e5-247f-4dd3-8477-f62770c409fc tempest-GroupsV320Test-676970992 None] Group tempest-GroupsV320Test-Group-1383700297: created successfully Apr 30 10:58:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-207f94e5-247f-4dd3-8477-f62770c409fc tempest-GroupsV320Test-676970992 None] Create group completed successfully. Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Created reservations ['cb31e17a-f821-487c-bd00-70b7043da8ad'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:17 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:58:17 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:18 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.634s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:18 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:58:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-83a70b0e-fb8b-4cc2-a28a-886771808139 tempest-GroupsV320Test-676970992 None] Delete group completed successfully. Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Flow 'volume_create_manager' (6e81b833-79e3-4af7-bb43-7e78af36c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefc24fe-ba5d-4bf0-a4dd-46da754e7abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefc24fe-ba5d-4bf0-a4dd-46da754e7abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2067111912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafba3139552497e929f7872d6e7498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:27Z,use_quota=True,user_id='ea06e1406dab41a1b78f166a8376a4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa35081c-e4fa-4e06-b85e-d2eacc8e9653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa35081c-e4fa-4e06-b85e-d2eacc8e9653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8b3f36-6f34-4772-aab0-9a913ce324cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8b3f36-6f34-4772-aab0-9a913ce324cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e', 'volume_name': 'volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeaa4d41-be99-4429-bbd1-6a6c1b60e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeaa4d41-be99-4429-bbd1-6a6c1b60e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e771c65-fd03-4d99-a328-2a062398ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:27 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e', 'volume_size': 1} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2067111912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aafba3139552497e929f7872d6e7498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:27Z,use_quota=True,user_id='ea06e1406dab41a1b78f166a8376a4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Creating volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:58:27 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:58:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:27 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e 1073741824 Apr 30 10:58:27 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:28 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e 1073741824" returned: 0 in 0.995s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:28 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e Apr 30 10:58:28 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Flow 'volume_create_manager' (4a44330e-c8ff-425c-bd95-d9eea0120535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3426cf5a-b7e7-483f-9971-35f4d83c1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3426cf5a-b7e7-483f-9971-35f4d83c1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-780614066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24027624-7907-493c-be4b-b98369681d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd90d85d538c49b685aa1df08dcb3614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:28Z,use_quota=True,user_id='07e26e1c88dc4d27bd40fb75a69e2597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc9d28f-e56b-458b-a1a7-70ba840cea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc9d28f-e56b-458b-a1a7-70ba840cea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b43ce7-040a-4ea7-aa7d-34050b58fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b43ce7-040a-4ea7-aa7d-34050b58fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24027624-7907-493c-be4b-b98369681d8d', 'volume_name': 'volume-24027624-7907-493c-be4b-b98369681d8d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b377f-d0dd-4c93-a914-0ce9943170b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b377f-d0dd-4c93-a914-0ce9943170b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60041c9-a287-460b-b882-e8c2c7e19acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Volume 24027624-7907-493c-be4b-b98369681d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24027624-7907-493c-be4b-b98369681d8d', 'volume_size': 1} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:28 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" returned: 0 in 0.737s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-780614066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24027624-7907-493c-be4b-b98369681d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd90d85d538c49b685aa1df08dcb3614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:28Z,use_quota=True,user_id='07e26e1c88dc4d27bd40fb75a69e2597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Creating volume 24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:58:28 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e771c65-fd03-4d99-a328-2a062398ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d 1073741824 Apr 30 10:58:28 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c294239b-48b3-4bd0-a325-a995238c3b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Volume volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e (b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e): created successfully Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c294239b-48b3-4bd0-a325-a995238c3b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Flow 'volume_create_manager' (6e81b833-79e3-4af7-bb43-7e78af36c057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d24afa10-21e1-4030-8d8b-e020f153e474 tempest-SnapshotsActionsTest-544859176 None] Created volume successfully. Apr 30 10:58:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:30 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d 1073741824" returned: 0 in 1.337s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:30 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d Apr 30 10:58:30 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9a651888-4793-4689-8367-6ce51ac5c582 req-05fcdc4a-f586-4b87-bdad-6a85d5d28240 tempest-ServerActionsTestOtherB-693036907 None] Terminate volume connection completed successfully. Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9a651888-4793-4689-8367-6ce51ac5c582 req-05fcdc4a-f586-4b87-bdad-6a85d5d28240 tempest-ServerActionsTestOtherB-693036907 None] Deleting attachment e93357a8-a360-4758-a94d-627414c3e9ea. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:58:30 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.429s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60041c9-a287-460b-b882-e8c2c7e19acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24027624-7907-493c-be4b-b98369681d8d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562f93ee-da9e-4440-8fd0-211f3f1e0729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Creating offline snapshot 6b46321c-fc64-4f28-bc6c-da68743adb36 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:58:30 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Volume volume-24027624-7907-493c-be4b-b98369681d8d (24027624-7907-493c-be4b-b98369681d8d): created successfully Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562f93ee-da9e-4440-8fd0-211f3f1e0729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Flow 'volume_create_manager' (4a44330e-c8ff-425c-bd95-d9eea0120535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc90bb2-541e-4058-9f0e-462c25f893d8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-cda83f6e-f36c-427d-9067-481369bce3fa req-6129cba2-90f4-4d60-b148-edb7ae01e532 tempest-VolumesSnapshotsTestJSON-1631395465 None] Created volume successfully. Apr 30 10:58:31 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e Apr 30 10:58:31 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:31 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" returned: 0 in 0.879s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:31 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 1G Apr 30 10:58:31 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:33 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 1G" returned: 0 in 1.150s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:33 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:33 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:33 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.757s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:33 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 is being set with open permissions: ugo+rw Apr 30 10:58:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:33 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:33 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:34 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.609s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:34 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info Apr 30 10:58:34 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:35 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:35 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info is being set with open permissions: ugo+rw Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:35 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info Apr 30 10:58:35 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:35 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.info" returned: 0 in 0.589s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.767s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.316s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Creating offline snapshot 23c7dfe1-6c88-4786-8267-d74e8371d15c of volume 24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5667e52-58ce-4ae6-89f5-9a6e6fa22866]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d4656d4d-133f-472f-a88a-a828c10084f4 tempest-SnapshotsActionsTest-544859176 None] Create snapshot completed successfully Apr 30 10:58:35 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d Apr 30 10:58:35 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:36 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:36 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c 1G Apr 30 10:58:36 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:37 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c 1G" returned: 0 in 0.774s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24027624-7907-493c-be4b-b98369681d8d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:37 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24027624-7907-493c-be4b-b98369681d8d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c Apr 30 10:58:37 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:37 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24027624-7907-493c-be4b-b98369681d8d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:37 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c is being set with open permissions: ugo+rw Apr 30 10:58:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:37 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c Apr 30 10:58:37 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:38 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c" returned: 0 in 0.623s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:38 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info Apr 30 10:58:38 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:39 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info" returned: 0 in 0.630s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:39 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info is being set with open permissions: ugo+rw Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:39 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info Apr 30 10:58:39 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:39 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.info" returned: 0 in 0.572s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.980s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.512s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4731b1-0e2b-4c51-ab31-2f7344c2eee7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-56d980c0-af13-4bea-ad18-d6baad318028 req-9cdf5196-f3b7-4f57-952b-8db2bace7231 tempest-VolumesSnapshotsTestJSON-1631395465 None] Create snapshot completed successfully Apr 30 10:58:39 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:58:39 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "cinder-23c7dfe1-6c88-4786-8267-d74e8371d15c-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-23c7dfe1-6c88-4786-8267-d74e8371d15c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "cinder-quobyte-23c7dfe1-6c88-4786-8267-d74e8371d15c" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-23c7dfe1-6c88-4786-8267-d74e8371d15c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Deleting offline snapshot 23c7dfe1-6c88-4786-8267-d74e8371d15c of volume 24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] snapshot_file for this snap is: volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57f522-3471-4d66-9625-1e54e1dcee5b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:40 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 0.768s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.087s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Creating offline snapshot 7ff8b49e-49f2-4245-ab53-6de3dd15be74 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:58:40 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c Apr 30 10:58:40 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[94802f84-44cd-4945-a744-66e5bfd0fb25]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '487b8d15-b5fa-4c54-abc7-73c51a310c0a', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:58:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9a651888-4793-4689-8367-6ce51ac5c582 req-04eb6266-ae59-437a-8a31-515bc3a7ce9f tempest-ServerActionsTestOtherB-693036907 None] attachment_update completed successfully. Apr 30 10:58:40 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:40 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:41 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c" returned: 0 in 0.764s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24027624-7907-493c-be4b-b98369681d8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f8521-b5be-4265-abf0-3dff5d223772]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:41 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.769s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:41 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d Apr 30 10:58:41 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:41 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 1G Apr 30 10:58:41 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:41 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d" returned: 0 in 0.784s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:41 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c Apr 30 10:58:41 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:42 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 1G" returned: 0 in 0.902s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:42 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 Apr 30 10:58:42 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:42 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c" returned: 0 in 0.795s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:42 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c Apr 30 10:58:42 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:43 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74" returned: 0 in 0.830s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:43 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 is being set with open permissions: ugo+rw Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:43 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 Apr 30 10:58:43 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:43 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d.23c7dfe1-6c88-4786-8267-d74e8371d15c" returned: 0 in 0.715s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-23c7dfe1-6c88-4786-8267-d74e8371d15c" released by "_delete_snapshot" :: held 3.178s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" released by "delete_snapshot" :: held 3.204s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:43 devstack cinder-volume[84432]: WARNING cinder.quota [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG cinder.quota [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Created reservations ['7c24718e-6172-4d33-8bd3-8436618234fb', '74cf97a7-8cbe-4741-b51b-be32a5c85d8a', '18b650a3-db6c-4d9b-b624-df2a67d3f4da', 'ae617d2c-143f-4b7e-820c-902fca69932f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Delete snapshot completed successfully. Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-9520f99f-fcb8-4e3a-93f2-105f6d62bcaf req-cbf41256-c8bb-4240-9273-6df53b25b86e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-23c7dfe1-6c88-4786-8267-d74e8371d15c-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:43 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.432s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a7c33649-3cd1-41c3-aaec-88fb4cf10748 tempest-SnapshotsActionsTest-544859176 None] Create snapshot completed successfully Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "cinder-24027624-7907-493c-be4b-b98369681d8d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-7ff8b49e-49f2-4245-ab53-6de3dd15be74-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-24027624-7907-493c-be4b-b98369681d8d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-7ff8b49e-49f2-4245-ab53-6de3dd15be74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-7ff8b49e-49f2-4245-ab53-6de3dd15be74" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-7ff8b49e-49f2-4245-ab53-6de3dd15be74" acquired by "_delete_snapshot" :: waited 0.169s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Deleting offline snapshot 7ff8b49e-49f2-4245-ab53-6de3dd15be74 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] snapshot_file for this snap is: volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9459ab6-4d07-4e11-8f20-2a3056097658]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512698a-e022-4e99-99e2-6ef4b95032f9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:45 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d Apr 30 10:58:45 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:45 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 Apr 30 10:58:45 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:46 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d" returned: 0 in 1.130s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:46 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d Apr 30 10:58:46 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:46 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74" returned: 0 in 1.481s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc56147-393a-4ac1-a893-2bf783c65b85]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:46 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:46 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (1d28576e-ab63-4981-bcfc-638193590387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4af366-321a-4680-9d42-459f6dc17c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:47 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-24027624-7907-493c-be4b-b98369681d8d" returned: 0 in 0.961s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-quobyte-24027624-7907-493c-be4b-b98369681d8d" released by "delete_volume" :: held 2.329s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4af366-321a-4680-9d42-459f6dc17c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-410486910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777a4c0e-60bb-43a4-b75d-031144db66ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:47Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4282d8a-572a-4936-9efe-4c92ffe99f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4282d8a-572a-4936-9efe-4c92ffe99f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545fa623-ab2d-4c6c-ae30-f36b10ec4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545fa623-ab2d-4c6c-ae30-f36b10ec4eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777a4c0e-60bb-43a4-b75d-031144db66ca', 'volume_name': 'volume-777a4c0e-60bb-43a4-b75d-031144db66ca', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fd8e2f-25fa-4255-889f-773da8578398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fd8e2f-25fa-4255-889f-773da8578398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21e9dc-e847-4f26-8535-74fb2502e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Volume 777a4c0e-60bb-43a4-b75d-031144db66ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777a4c0e-60bb-43a4-b75d-031144db66ca', 'volume_size': 1} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-410486910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777a4c0e-60bb-43a4-b75d-031144db66ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:47Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Creating volume 777a4c0e-60bb-43a4-b75d-031144db66ca {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:58:47 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:47 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca 1073741824 Apr 30 10:58:47 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.quota [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Created reservations ['ad03ccdc-7bb9-428e-a64b-69c8cce12c07', '0017c452-d282-41ac-b898-392e5c44f3b2', 'dd5a0b3e-3075-41aa-a0b9-b409ab0f8524', 'eb12184a-7252-4549-9896-779d2dc7f3af'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:47 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:58:47 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:48 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 1.287s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:48 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 Apr 30 10:58:48 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:48 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG cinder.manager [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:58:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Deleted volume successfully. Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=55,cinder:UPDATE=54,cinder:INSERT=13,cinder:DELETE=7 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-6122f1b3-ad10-494f-a2e9-ae274710be00 req-7f297b92-fcb1-4015-b1b1-56ebda5cf79e tempest-VolumesSnapshotsTestJSON-1631395465 None] Lock "cinder-24027624-7907-493c-be4b-b98369681d8d-delete_volume" released by "delete_volume" :: held 3.618s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:48 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca 1073741824" returned: 0 in 1.546s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=59,cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:58:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:49 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca Apr 30 10:58:49 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:49 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74" returned: 0 in 1.514s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:49 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74 Apr 30 10:58:49 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:50 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca" returned: 0 in 1.093s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] <== create_volume: return (2724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.733s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21e9dc-e847-4f26-8535-74fb2502e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777a4c0e-60bb-43a4-b75d-031144db66ca', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfbb383-d7a5-4337-b8be-e781ff169b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:50 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Volume volume-777a4c0e-60bb-43a4-b75d-031144db66ca (777a4c0e-60bb-43a4-b75d-031144db66ca): created successfully Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfbb383-d7a5-4337-b8be-e781ff169b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (1d28576e-ab63-4981-bcfc-638193590387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3338eabb-e18a-4d5f-aae7-41cba4fefc40 tempest-AttachVolumeTestJSON-686146806 None] Created volume successfully. Apr 30 10:58:50 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.7ff8b49e-49f2-4245-ab53-6de3dd15be74" returned: 0 in 0.885s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-7ff8b49e-49f2-4245-ab53-6de3dd15be74" released by "_delete_snapshot" :: held 5.354s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_snapshot" :: held 5.539s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Created reservations ['384197df-4f66-49c0-b26a-6556d126174e', '814070a4-5d15-4288-9335-916e5e1db7f2', '2d72f39b-c1d5-4e0f-9fe5-a9e5174ee147', 'fbcd8e2a-e4d3-4f27-b72e-7cc8bf71f720'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Delete snapshot completed successfully. Apr 30 10:58:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cacff4b9-9824-4d3f-842a-252d6e0b44d5 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-7ff8b49e-49f2-4245-ab53-6de3dd15be74-delete_snapshot" released by "delete_snapshot" :: held 5.761s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Creating offline snapshot 50307f4b-5b61-437a-8c3d-119d8a6b0f89 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:58:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a533476-0ca5-4763-a227-0a8e29065bd1]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:51 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:51 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:52 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.947s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:52 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 1G Apr 30 10:58:52 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:54 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 1G" returned: 0 in 1.358s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:54 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:58:54 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Flow 'volume_create_manager' (a4790284-c280-4062-ba7b-b8c632d4fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f97b9c-f15d-47c9-8ce6-bc9cdc37864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f97b9c-f15d-47c9-8ce6-bc9cdc37864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2008210743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9597ab0-ba28-401f-b27c-cd42332afb1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbd685e0d2ff4841add99e2cf0fb8fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:54Z,use_quota=True,user_id='437629a6f4234d958be04824f754572c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557860c-b555-4bfe-935a-1f0a4256ca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557860c-b555-4bfe-935a-1f0a4256ca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04008ce6-e155-45f2-81dd-a8f6f0554c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04008ce6-e155-45f2-81dd-a8f6f0554c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9597ab0-ba28-401f-b27c-cd42332afb1f', 'volume_name': 'volume-c9597ab0-ba28-401f-b27c-cd42332afb1f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fe71cf-99bd-4c30-9258-22609a1f0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fe71cf-99bd-4c30-9258-22609a1f0f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8441742e-001c-4ea0-b7e9-9af151af717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Volume c9597ab0-ba28-401f-b27c-cd42332afb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9597ab0-ba28-401f-b27c-cd42332afb1f', 'volume_size': 1} Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-d1e553f1-57a1-406d-8265-de4a93dc1338 tempest-ServerActionsTestOtherB-693036907 None] Terminate volume connection completed successfully. Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-d1e553f1-57a1-406d-8265-de4a93dc1338 tempest-ServerActionsTestOtherB-693036907 None] Deleting attachment 487b8d15-b5fa-4c54-abc7-73c51a310c0a. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:58:54 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89" returned: 0 in 0.685s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:54 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 is being set with open permissions: ugo+rw Apr 30 10:58:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:54 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 Apr 30 10:58:54 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:55 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89" returned: 0 in 0.606s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.698s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.603s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb3944-5a56-4366-8adc-69d0c8a5d1e9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-10e8cef2-3054-4305-bb6a-0605b2a0ea2f tempest-SnapshotsActionsTest-544859176 None] Create snapshot completed successfully Apr 30 10:58:55 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca Apr 30 10:58:55 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-50307f4b-5b61-437a-8c3d-119d8a6b0f89-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-50307f4b-5b61-437a-8c3d-119d8a6b0f89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:56 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca" returned: 0 in 0.743s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2008210743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9597ab0-ba28-401f-b27c-cd42332afb1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbd685e0d2ff4841add99e2cf0fb8fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:58:54Z,use_quota=True,user_id='437629a6f4234d958be04824f754572c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Creating volume c9597ab0-ba28-401f-b27c-cd42332afb1f {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:58:56 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-50307f4b-5b61-437a-8c3d-119d8a6b0f89" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:56 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f 1073741824 Apr 30 10:58:56 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-50307f4b-5b61-437a-8c3d-119d8a6b0f89" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Deleting offline snapshot 50307f4b-5b61-437a-8c3d-119d8a6b0f89 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] snapshot_file for this snap is: volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-777a4c0e-60bb-43a4-b75d-031144db66ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea144b3d-91d9-4f6b-87b7-da0e3e148ab5', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f81386-5cf0-4a99-92d4-e4adaa8255b4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-55506eaa-c482-4137-b7c9-c85fa8d5d408 req-ecbdcb43-a5e6-4017-ad5f-369100a70d4e tempest-AttachVolumeTestJSON-686146806 None] attachment_update completed successfully. Apr 30 10:58:56 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 Apr 30 10:58:56 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:57 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f 1073741824" returned: 0 in 0.878s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:57 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89" returned: 0 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:57 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f Apr 30 10:58:57 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d09a1-ba78-46c5-affa-3b803d8afc41]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:57 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:58:57 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:57 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f" returned: 0 in 0.691s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8441742e-001c-4ea0-b7e9-9af151af717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9597ab0-ba28-401f-b27c-cd42332afb1f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedf63c-e02e-4f8e-a1ae-6fa41246b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:58:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Volume volume-c9597ab0-ba28-401f-b27c-cd42332afb1f (c9597ab0-ba28-401f-b27c-cd42332afb1f): created successfully Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedf63c-e02e-4f8e-a1ae-6fa41246b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:58:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Flow 'volume_create_manager' (a4790284-c280-4062-ba7b-b8c632d4fddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:58:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-b552c831-e83a-42c3-b977-4ebcd9c9f20d req-058c6e87-1121-492a-a2e0-3e23ddd09d20 tempest-VolumesGetTestJSON-1087015081 None] Created volume successfully. Apr 30 10:58:58 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.840s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:58 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 Apr 30 10:58:58 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:58 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89" returned: 0 in 0.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:58 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89 Apr 30 10:58:58 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Acquiring lock "cinder-c9597ab0-ba28-401f-b27c-cd42332afb1f-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "cinder-c9597ab0-ba28-401f-b27c-cd42332afb1f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Acquiring lock "cinder-quobyte-c9597ab0-ba28-401f-b27c-cd42332afb1f" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "cinder-quobyte-c9597ab0-ba28-401f-b27c-cd42332afb1f" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[072590fb-5c96-4f41-af1d-6c756d69c25d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:59 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f Apr 30 10:58:59 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:58:59 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.50307f4b-5b61-437a-8c3d-119d8a6b0f89" returned: 0 in 0.672s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-50307f4b-5b61-437a-8c3d-119d8a6b0f89" released by "_delete_snapshot" :: held 3.236s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_snapshot" :: held 3.263s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Created reservations ['d078509c-f5d2-412c-ab7f-9a3f2e4f138a', '7bfd04b1-c5fb-4bb1-98a8-74f1249e0306', 'fd6cf047-bc6e-4be4-915f-d22698be9074', 'd2b673ce-80ab-43c4-9864-29c186e35426'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:58:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Delete snapshot completed successfully. Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a3e1e476-caa1-4c3e-baab-09d4c239c4df tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-50307f4b-5b61-437a-8c3d-119d8a6b0f89-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:58:59 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f" returned: 0 in 0.727s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:58:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:58:59 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f Apr 30 10:58:59 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:00 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c9597ab0-ba28-401f-b27c-cd42332afb1f" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "cinder-quobyte-c9597ab0-ba28-401f-b27c-cd42332afb1f" released by "delete_volume" :: held 1.424s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG cinder.quota [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Created reservations ['9454ae37-26fb-47e8-8dcd-0e202916e0bd', 'a0710a0b-aa74-4d3e-b22f-55e69521bac7', 'bebbf02f-ee44-4fe4-9651-675f9eabfd9a', '18598fcd-5502-405c-ab68-a891126683c8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:00 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:00 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Creating offline snapshot bb9f7e92-a3f3-48fc-a530-036b66af1e78 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0506f8-3fd0-4fa5-825a-e9e7a3b1c386]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:00 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:00 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:01 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG cinder.manager [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Deleted volume successfully. Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-67ad11bd-b883-4b35-835f-3f87fa537125 req-e0d8de05-10a9-4531-bfa5-0e529895e7d2 tempest-VolumesGetTestJSON-1087015081 None] Lock "cinder-c9597ab0-ba28-401f-b27c-cd42332afb1f-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:01 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.927s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:01 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 1G Apr 30 10:59:01 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (6c30fa94-9580-4d08-b794-df543cf0edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fc2946-af39-457e-b7d8-2fd8f105106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fc2946-af39-457e-b7d8-2fd8f105106f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1785196494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffe2940-2d5b-4b11-8e50-89c763e04923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:02Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2d6826-7bb5-4752-80c4-662d3dfd9ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2d6826-7bb5-4752-80c4-662d3dfd9ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2677ec6c-48c2-4aba-9586-e1048d5e2b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2677ec6c-48c2-4aba-9586-e1048d5e2b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffe2940-2d5b-4b11-8e50-89c763e04923', 'volume_name': 'volume-4ffe2940-2d5b-4b11-8e50-89c763e04923', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2884abb2-19d2-46ce-94ef-a8bb455d22a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2884abb2-19d2-46ce-94ef-a8bb455d22a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab02589-3baf-42a0-8fa4-650c80d0c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Volume 4ffe2940-2d5b-4b11-8e50-89c763e04923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffe2940-2d5b-4b11-8e50-89c763e04923', 'volume_size': 1} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:02 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 1G" returned: 0 in 0.957s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:02 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 Apr 30 10:59:02 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:03 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78" returned: 0 in 0.780s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:03 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 is being set with open permissions: ugo+rw Apr 30 10:59:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:03 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 Apr 30 10:59:03 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:04 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1785196494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffe2940-2d5b-4b11-8e50-89c763e04923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28f9fdfff1493ba98ed52045623f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:02Z,use_quota=True,user_id='3c43a4309819433185394fb10784624e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Creating volume 4ffe2940-2d5b-4b11-8e50-89c763e04923 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:04 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:59:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:04 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 1073741824 Apr 30 10:59:04 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4f9e1ef5-b476-40e8-bde4-1dcdee977096 tempest-SnapshotsActionsTest-544859176 None] Create snapshot completed successfully Apr 30 10:59:05 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 1073741824" returned: 0 in 0.843s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:05 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 Apr 30 10:59:05 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5034812d-286e-4688-ae68-473d7abd767a tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-489040102: creating Apr 30 10:59:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5034812d-286e-4688-ae68-473d7abd767a tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-489040102: created successfully Apr 30 10:59:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5034812d-286e-4688-ae68-473d7abd767a tempest-GroupSnapshotsTest-1533913445 None] Create group completed successfully. Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-bb9f7e92-a3f3-48fc-a530-036b66af1e78-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-bb9f7e92-a3f3-48fc-a530-036b66af1e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-bb9f7e92-a3f3-48fc-a530-036b66af1e78" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-bb9f7e92-a3f3-48fc-a530-036b66af1e78" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Deleting offline snapshot bb9f7e92-a3f3-48fc-a530-036b66af1e78 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] snapshot_file for this snap is: volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e33b881-84c0-48b0-a88d-003c2977e379]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:05 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923" returned: 0 in 0.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.301s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab02589-3baf-42a0-8fa4-650c80d0c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffe2940-2d5b-4b11-8e50-89c763e04923', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3527c7f-f198-40c9-9e20-7f02fa852de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c1678-6d81-45e9-8f6e-1bb4c83c6dad]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:05 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 Apr 30 10:59:05 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:05 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Volume volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 (4ffe2940-2d5b-4b11-8e50-89c763e04923): created successfully Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3527c7f-f198-40c9-9e20-7f02fa852de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Flow 'volume_create_manager' (6c30fa94-9580-4d08-b794-df543cf0edc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0bc32d2c-1b84-4777-a43c-02dbdc0f7e8b tempest-AttachVolumeTestJSON-686146806 None] Created volume successfully. Apr 30 10:59:05 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:59:05 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:06 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:06 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:06 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe27af-3bc4-443d-8dcc-1b748fa77ed8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:06 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:06 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:06 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 0.839s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ccf3e6-e01e-4b6c-951a-c77808441b2a', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:59:06 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.667s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-48d40ca7-4e76-4fe6-9058-a8838c1ed975 req-10a32cf2-9222-4b28-937f-a0b9d88b1604 tempest-ServerActionsTestOtherB-693036907 None] attachment_update completed successfully. Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (94e28245-6b60-488d-bc25-5f9ee6029d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3250aa-2e79-4e11-adc0-cdb3d8a49c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3250aa-2e79-4e11-adc0-cdb3d8a49c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155013632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bb5ebc8-f92c-41aa-a3d2-b7381778dcb0,host='devstack@QuobyteHD#QuobyteHD',id=f04cc4af-d0ed-4ce5-aff9-f2033bc13489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:07Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45032022-06bf-458c-aa09-fa8dfc986c1f),volume_type_id=45032022-06bf-458c-aa09-fa8dfc986c1f)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d1ae9a-c69b-456d-8a7a-e4098ab808f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d1ae9a-c69b-456d-8a7a-e4098ab808f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eabc7f3-2f52-4675-80c6-c17b804bda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eabc7f3-2f52-4675-80c6-c17b804bda9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04cc4af-d0ed-4ce5-aff9-f2033bc13489', 'volume_name': 'volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e84fcc-07aa-4bd6-b492-0ab4b0f02323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e84fcc-07aa-4bd6-b492-0ab4b0f02323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae1fa87-d15c-415e-8d28-e9f20b1dd28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Volume f04cc4af-d0ed-4ce5-aff9-f2033bc13489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489', 'volume_size': 1} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0bb5ebc8-f92c-41aa-a3d2-b7381778dcb0,created_at=2026-04-30T08:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155013632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bb5ebc8-f92c-41aa-a3d2-b7381778dcb0,host='devstack@QuobyteHD#QuobyteHD',id=f04cc4af-d0ed-4ce5-aff9-f2033bc13489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:07Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45032022-06bf-458c-aa09-fa8dfc986c1f),volume_type_id=45032022-06bf-458c-aa09-fa8dfc986c1f)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Creating volume f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:07 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:07 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.896s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:07 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 1073741824 Apr 30 10:59:07 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:07 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 Apr 30 10:59:07 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:08 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78" returned: 0 in 0.770s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:08 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78 Apr 30 10:59:08 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:08 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 1073741824" returned: 0 in 0.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:08 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:08 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:08 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.bb9f7e92-a3f3-48fc-a530-036b66af1e78" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-bb9f7e92-a3f3-48fc-a530-036b66af1e78" released by "_delete_snapshot" :: held 3.167s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_snapshot" :: held 3.205s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:08 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Created reservations ['b4d28a8a-4b65-4098-873f-063508c5d963', '27961ab1-cb1c-451e-9a9e-4021719ff2b9', 'da1c850b-1ee2-47e9-8a94-2190a055fab1', '5a0c600f-ac12-47b7-8901-e24d13d3893d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:08 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.648s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae1fa87-d15c-415e-8d28-e9f20b1dd28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe05231-30f9-4277-9c0f-96b5e09e8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:09 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Volume volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 (f04cc4af-d0ed-4ce5-aff9-f2033bc13489): created successfully Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe05231-30f9-4277-9c0f-96b5e09e8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (94e28245-6b60-488d-bc25-5f9ee6029d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Delete snapshot completed successfully. Apr 30 10:59:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f659b84-535a-44f9-8cbf-3c4614789f85 tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-bb9f7e92-a3f3-48fc-a530-036b66af1e78-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c359f090-6f58-4e85-bfca-31229de74ac7 tempest-GroupSnapshotsTest-1533913445 None] Created volume successfully. Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Creating offline snapshot 6282b402-eeaa-4666-bc96-2a6f22353fc6 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e2c33-554f-48df-83df-1f44c0dc4559]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] GroupSnapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: creating. Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Group snapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: creating. {{(pid=84432) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:10 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:10 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:10 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:10 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 1G Apr 30 10:59:10 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:11 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 1G" returned: 0 in 0.807s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:11 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 Apr 30 10:59:11 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:12 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6" returned: 0 in 0.808s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:12 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 is being set with open permissions: ugo+rw Apr 30 10:59:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:12 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 Apr 30 10:59:12 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:13 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6" returned: 0 in 0.665s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.977s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Creating offline snapshot cf1e1aeb-d01a-42a9-8b93-5c620676e01f of volume f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:59:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2037a6fd-ea21-4418-9379-d61b111b1505 tempest-SnapshotsActionsTest-544859176 None] Create snapshot completed successfully Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[612368e7-07e3-4ffc-a366-218f9cb59e10]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:13 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:13 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-6282b402-eeaa-4666-bc96-2a6f22353fc6-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-6282b402-eeaa-4666-bc96-2a6f22353fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Acquiring lock "cinder-quobyte-6282b402-eeaa-4666-bc96-2a6f22353fc6" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-6282b402-eeaa-4666-bc96-2a6f22353fc6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Deleting offline snapshot 6282b402-eeaa-4666-bc96-2a6f22353fc6 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] snapshot_file for this snap is: volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ad85d-35b9-4396-aa8f-db67cdc2bd97]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:13 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 Apr 30 10:59:13 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:14 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.890s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:14 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f 1G Apr 30 10:59:14 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:14 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6" returned: 0 in 0.958s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ef2cd-9d1d-43aa-86c4-1bc586bf8e44]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:14 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:14 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:15 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f 1G" returned: 0 in 1.025s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:15 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:15 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:15 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:15 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 Apr 30 10:59:15 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:15 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 0.677s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:15 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f is being set with open permissions: ugo+rw: NotImplementedError Apr 30 10:59:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:15 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:15 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:16 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6" returned: 0 in 0.839s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:16 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6 Apr 30 10:59:16 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:16 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 0.640s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:16 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info Apr 30 10:59:16 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:16 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6282b402-eeaa-4666-bc96-2a6f22353fc6" returned: 0 in 0.704s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-6282b402-eeaa-4666-bc96-2a6f22353fc6" released by "_delete_snapshot" :: held 3.364s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_snapshot" :: held 3.395s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Created reservations ['6d849fea-6d64-425f-9174-a75e8223ee4d', 'f3cbd1fd-9fa8-4180-8222-8ba14d9a00e1', '7a38e3c2-7afd-406a-8d34-e19f44861a4d', 'da846ee6-35e3-439c-8b74-e4b805904bd8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Delete snapshot completed successfully. Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8674ead2-2db7-4a83-a265-86fde88af8cf tempest-SnapshotsActionsTest-55625952 None] Lock "cinder-6282b402-eeaa-4666-bc96-2a6f22353fc6-delete_snapshot" released by "delete_snapshot" :: held 3.566s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:17 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:17 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:17 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info Apr 30 10:59:17 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-ec7c7208-e8b7-40fe-81e6-c45a90067f43 req-77c44a91-7d29-4257-82d6-6cd9add60588 tempest-ServerActionsTestOtherB-693036907 None] Terminate volume connection completed successfully. Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-ec7c7208-e8b7-40fe-81e6-c45a90067f43 req-77c44a91-7d29-4257-82d6-6cd9add60588 tempest-ServerActionsTestOtherB-693036907 None] Deleting attachment 93ccf3e6-e01e-4b6c-951a-c77808441b2a. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:59:17 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.info" returned: 0 in 0.572s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.587s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.344s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8059fab1-12c0-49dc-8cb8-ed4999df50a0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b6815799-4d1a-44fd-8b86-8b5bd1b90bcb tempest-GroupSnapshotsTest-1533913445 None] group_snapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: created successfully Apr 30 10:59:17 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 Apr 30 10:59:17 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:18 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923" returned: 0 in 0.741s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-4ffe2940-2d5b-4b11-8e50-89c763e04923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a592a374-3c4c-43ef-9daa-d6ffa85f3746', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 10:59:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-a56e518a-4512-4844-ac2d-4e5e12bbf108 req-23f671e9-5472-46e0-b9f3-163087918db4 tempest-AttachVolumeTestJSON-686146806 None] attachment_update completed successfully. Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "cinder-6b46321c-fc64-4f28-bc6c-da68743adb36-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-6b46321c-fc64-4f28-bc6c-da68743adb36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "cinder-quobyte-6b46321c-fc64-4f28-bc6c-da68743adb36" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-6b46321c-fc64-4f28-bc6c-da68743adb36" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Deleting offline snapshot 6b46321c-fc64-4f28-bc6c-da68743adb36 of volume b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] snapshot_file for this snap is: volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba1cac0-e3ce-4d2b-ba4b-6a91ca72ddd3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Creating volume 07255f0a-bfd3-4ccf-926b-7a5436d2d2ce from snapshot cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] snapshot: cf1e1aeb-d01a-42a9-8b93-5c620676e01f, volume: 07255f0a-bfd3-4ccf-926b-7a5436d2d2ce, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 10:59:19 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:19 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5763c5-99c9-48fa-8c73-5b79e1e8766a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "cinder-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "cinder-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:19 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "cinder-quobyte-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "cinder-quobyte-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2dbda6-eef6-4ebe-b6ef-36bbeb773702]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:20 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:59:20 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:20 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.900s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf3035a-869b-4387-a33d-f9fb30ef7128]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:20 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e Apr 30 10:59:20 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:20 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a423235f-8ec3-4635-91c5-9b2b2313f137]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:20 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:20 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:20 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 0.785s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:20 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e Apr 30 10:59:20 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:21 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" returned: 0 in 0.743s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:21 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:21 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:21 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.755s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:21 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce Apr 30 10:59:21 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:21 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" returned: 0 in 0.657s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "cinder-quobyte-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e" released by "delete_volume" :: held 1.491s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Created reservations ['37edcb05-cd18-4580-a9da-e00e06151574', '2fc3beb6-ddcc-4765-b3b2-de25cd71fd67', 'd224a8a9-2a53-4fc6-8c01-dd350c334656', 'b2daad2c-125d-4ace-9365-9f32acc61298'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:21 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:21 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:21 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:21 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36 Apr 30 10:59:21 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:22 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.633s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:22 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Deleted volume successfully. Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8059c0f2-994f-4b1e-b29d-7256c6eb83f4 tempest-ServerActionsTestOtherB-693036907 None] Lock "cinder-32e5c8f1-9fa2-4b20-9096-7da5a2b6697e-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:22 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e.6b46321c-fc64-4f28-bc6c-da68743adb36" returned: 0 in 0.936s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-6b46321c-fc64-4f28-bc6c-da68743adb36" released by "_delete_snapshot" :: held 3.509s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_snapshot" :: held 3.542s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:23 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Created reservations ['2dca0e8b-f2db-4458-bb7a-ae593fc295fc', '868d488d-3028-4c71-8c5d-9195203f7737', '6afe0067-b345-4556-a4d6-49dbb0fa21ca', '0e551c1a-fd83-42f3-a191-7601484e7fc1'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Delete snapshot completed successfully. Apr 30 10:59:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ecbd3b45-8d34-4c32-9092-4e424dbcea96 tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-6b46321c-fc64-4f28-bc6c-da68743adb36-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "cinder-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" acquired by "delete_volume" :: waited 0.041s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c43d47-00c0-4540-ad08-ddbd2353cd36]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:24 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e Apr 30 10:59:24 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:26 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" returned: 0 in 2.188s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:26 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e Apr 30 10:59:26 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:26 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-20933882-f09e-4a3d-964c-9cc3ff76acbd req-eba40c89-f628-4f62-bb37-0c8c291703a0 tempest-AttachVolumeTestJSON-686146806 None] Terminate volume connection completed successfully. Apr 30 10:59:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-20933882-f09e-4a3d-964c-9cc3ff76acbd req-eba40c89-f628-4f62-bb37-0c8c291703a0 tempest-AttachVolumeTestJSON-686146806 None] Deleting attachment ea144b3d-91d9-4f6b-87b7-da0e3e148ab5. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:59:27 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" returned: 0 in 6.175s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[69994fd4-f000-4607-8bc0-303e8447b261]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:27 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" returned: 0 in 1.118s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-quobyte-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e" released by "delete_volume" :: held 3.464s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Created reservations ['7993abaa-9edd-4264-b547-e6fcfee4d432', 'f9336957-e7c1-4432-8e74-cd06a27d6540', '2aede3ab-e3dd-4eb4-9e8e-232ff029787b', 'aca6c0f5-52b6-4a76-98ba-52528ec9f5f4'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:27 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:27 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:27 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:27 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:28 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.739s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Deleted volume successfully. Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5924d568-e6de-457d-ac02-fe898783b53c tempest-SnapshotsActionsTest-544859176 None] Lock "cinder-b8afd9df-f8a9-41e3-a3b4-9b7de00fa02e-delete_volume" released by "delete_volume" :: held 4.518s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:28 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 1.124s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 10:59:28 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Converted 1024.00 MB image at 165.70 MB/s Apr 30 10:59:28 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce is being set with open permissions: ugo+rw: NotImplementedError Apr 30 10:59:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:28 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce Apr 30 10:59:28 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:29 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" returned: 0 in 0.836s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" released by "_copy_volume_from_snapshot" :: held 9.886s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:29 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-947ff999-35fa-492f-9515-d58fa71e72b8 req-1a19f949-758a-49ad-8e05-19fff721364b tempest-AttachVolumeTestJSON-686146806 None] Terminate volume connection completed successfully. Apr 30 10:59:29 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-947ff999-35fa-492f-9515-d58fa71e72b8 req-1a19f949-758a-49ad-8e05-19fff721364b tempest-AttachVolumeTestJSON-686146806 None] Deleting attachment a592a374-3c4c-43ef-9daa-d6ffa85f3746. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 10:59:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" released by "_create_volume_from_snapshot" :: held 9.933s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.953s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:29 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2753b92d-064c-4a74-821d-b65e08aac734 tempest-GroupSnapshotsTest-1533913445 None] Create group from source-snapshot-ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38 completed successfully. Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3069cb19-2c0b-4dc8-a61c-7140fc19981f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:31 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce Apr 30 10:59:31 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:31 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" returned: 0 in 0.874s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:32 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce Apr 30 10:59:32 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:32 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-07255f0a-bfd3-4ccf-926b-7a5436d2d2ce" released by "delete_volume" :: held 1.631s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['02f54c29-d49b-4891-883b-dbd4ebc90281'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:32 devstack cinder-volume[84432]: WARNING cinder.quota [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1529998953 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1529998953, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:59:32 devstack cinder-volume[84432]: WARNING cinder.quota [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1529998953 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1529998953, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['89eb9e07-d8b7-4f8e-ba97-3c45f89d0ea5', 'a5b4846f-c515-493a-8bbe-efad685e78d6', '9e6d7fe9-b512-4483-a7ab-4788b22e38f1', 'b9374cfb-415b-4282-9e02-24249368723a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:33 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:33 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: deleting Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: deleting {{(pid=84432) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Deleting offline snapshot cf1e1aeb-d01a-42a9-8b93-5c620676e01f of volume f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] snapshot_file for this snap is: volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e379279-cf1c-48ce-8480-2afb548d8a8b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:33 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:33 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:34 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.101s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c10a8330-a0d2-444c-9d6f-37a3fd973940 tempest-GroupSnapshotsTest-1533913445 None] Delete group completed successfully. Apr 30 10:59:34 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 1.086s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416ef61-2cfd-42e7-9d9b-37051b2c42b3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:35 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:35 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:35 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:35 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:35 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:36 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 0.882s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:36 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f Apr 30 10:59:36 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:37 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489.cf1e1aeb-d01a-42a9-8b93-5c620676e01f" returned: 0 in 0.754s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-cf1e1aeb-d01a-42a9-8b93-5c620676e01f" released by "_delete_snapshot" :: held 3.800s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" released by "delete_snapshot" :: held 3.832s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:37 devstack cinder-volume[84432]: WARNING cinder.quota [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1529998953 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1529998953, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:59:37 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['f251da0e-5d19-4030-9503-92f7303301a0', 'c8d62b86-34c5-4bfd-a697-35c698275b5f', '70cfecb2-bf04-43c3-860f-e11ae09fd9a5', '5baaf253-9263-4627-a199-d2f8937bd957'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-988c7ad7-e529-42ed-b578-3e8c58258cd6 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot ff3dfaf1-003c-461f-8a4d-2c1b9bfdbb38: deleted successfully Apr 30 10:59:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:38 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[42212e8b-3200-4404-99d5-14ab98f88e98]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:38 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:38 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:39 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:39 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489 Apr 30 10:59:39 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:40 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" returned: 0 in 0.846s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-f04cc4af-d0ed-4ce5-aff9-f2033bc13489" released by "delete_volume" :: held 1.758s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['025f670a-5535-47d3-9288-d758e31b49a8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:40 devstack cinder-volume[84432]: WARNING cinder.db.sqlalchemy.api [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1529998953'] Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['30fc3bf6-c142-4b5c-89b9-c516da5a7ea4', 'ba2f037b-9baa-447c-8239-3c1b21a4ae6c', 'ae7c9a0f-4410-4a98-b961-ae50e5bae12d', 'd6c82e76-d9db-43d0-b469-9525cce67832'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:40 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:40 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a7b92932-f144-4423-9c28-d302ec487dba tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-490239912: creating Apr 30 10:59:41 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a7b92932-f144-4423-9c28-d302ec487dba tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-490239912: created successfully Apr 30 10:59:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.988s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:41 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-212306af-f827-407c-8097-389f5931db04 tempest-GroupSnapshotsTest-1533913445 None] Delete group completed successfully. Apr 30 10:59:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a7b92932-f144-4423-9c28-d302ec487dba tempest-GroupSnapshotsTest-1533913445 None] Create group completed successfully. Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-4ffe2940-2d5b-4b11-8e50-89c763e04923-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-4ffe2940-2d5b-4b11-8e50-89c763e04923-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-quobyte-4ffe2940-2d5b-4b11-8e50-89c763e04923" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-4ffe2940-2d5b-4b11-8e50-89c763e04923" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[44356d7d-ff3b-498a-b36d-7cff93b0ac0e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:42 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 Apr 30 10:59:42 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (2ffc22a8-2c57-4505-89bc-799fae74675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47861214-671a-451e-ae66-7ea712a1b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47861214-671a-451e-ae66-7ea712a1b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75486474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a38516b8-f367-4355-9e88-1fd5a3773bac,host='devstack@QuobyteHD#QuobyteHD',id=9724d653-1338-41b7-9c0c-ddd1ee8a2d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:43Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553),volume_type_id=e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b144d5-6f7d-4db2-bcec-498b16b9bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b144d5-6f7d-4db2-bcec-498b16b9bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e174e02-7eb1-4e5f-bf61-11177af88624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e174e02-7eb1-4e5f-bf61-11177af88624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9724d653-1338-41b7-9c0c-ddd1ee8a2d60', 'volume_name': 'volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f48f060-68c2-4ebb-bd19-9efb106136ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f48f060-68c2-4ebb-bd19-9efb106136ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c049ce-defe-411f-b754-da80ddbd13ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Volume 9724d653-1338-41b7-9c0c-ddd1ee8a2d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60', 'volume_size': 1} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a38516b8-f367-4355-9e88-1fd5a3773bac,created_at=2026-04-30T08:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75486474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a38516b8-f367-4355-9e88-1fd5a3773bac,host='devstack@QuobyteHD#QuobyteHD',id=9724d653-1338-41b7-9c0c-ddd1ee8a2d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:43Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553),volume_type_id=e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Creating volume 9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:43 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:43 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 1073741824 Apr 30 10:59:43 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:43 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923" returned: 0 in 1.122s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:43 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923 Apr 30 10:59:43 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:44 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4ffe2940-2d5b-4b11-8e50-89c763e04923" returned: 0 in 1.068s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-4ffe2940-2d5b-4b11-8e50-89c763e04923" released by "delete_volume" :: held 2.270s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:44 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 1073741824" returned: 0 in 1.216s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Created reservations ['05a0dbff-f70b-4462-85df-62ddcc93cc9e', 'd019d0c8-b310-47fe-9e8b-8238e0af208e', 'f27ad001-887b-412e-9f2a-ea5a1032e463', 'df1d17a2-9fe7-437d-bdf1-5f3bb53300bb'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:44 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 Apr 30 10:59:44 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:44 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:44 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:45 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" returned: 0 in 0.833s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c049ce-defe-411f-b754-da80ddbd13ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e20438-c7c1-49ef-9141-a9500a592874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:45 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Volume volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 (9724d653-1338-41b7-9c0c-ddd1ee8a2d60): created successfully Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e20438-c7c1-49ef-9141-a9500a592874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (2ffc22a8-2c57-4505-89bc-799fae74675a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3a4ba9eb-880b-45ce-b8f2-87d18c7c7bef tempest-GroupSnapshotsTest-1533913445 None] Created volume successfully. Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-777a4c0e-60bb-43a4-b75d-031144db66ca-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-777a4c0e-60bb-43a4-b75d-031144db66ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-quobyte-777a4c0e-60bb-43a4-b75d-031144db66ca" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-777a4c0e-60bb-43a4-b75d-031144db66ca" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:45 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.072s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Deleted volume successfully. Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98dd90-fa10-4774-a16d-e48ff15b8071]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b860b514-0b49-4814-9f62-29b43d36cf65 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-4ffe2940-2d5b-4b11-8e50-89c763e04923-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:45 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca Apr 30 10:59:45 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:46 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca" returned: 0 in 0.850s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:46 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca Apr 30 10:59:46 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (5596593f-313d-4483-acd8-3ef7c192c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebd0f65-f31b-4715-a829-8c2465a1274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebd0f65-f31b-4715-a829-8c2465a1274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110533455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a38516b8-f367-4355-9e88-1fd5a3773bac,host='devstack@QuobyteHD#QuobyteHD',id=feb0d186-1cd5-4b8c-8b9d-360a493374e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:47Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553),volume_type_id=e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9e7eda-b0c8-436a-aabe-4b5a7cca0094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9e7eda-b0c8-436a-aabe-4b5a7cca0094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6784d86c-c62f-417c-9f96-6b3037375e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6784d86c-c62f-417c-9f96-6b3037375e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb0d186-1cd5-4b8c-8b9d-360a493374e0', 'volume_name': 'volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7917b28-50e7-436d-bc42-ffcee3581a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7917b28-50e7-436d-bc42-ffcee3581a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db156404-2c62-4f7e-a51e-eaaa07c52e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Volume feb0d186-1cd5-4b8c-8b9d-360a493374e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0', 'volume_size': 1} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a38516b8-f367-4355-9e88-1fd5a3773bac,created_at=2026-04-30T08:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110533455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a38516b8-f367-4355-9e88-1fd5a3773bac,host='devstack@QuobyteHD#QuobyteHD',id=feb0d186-1cd5-4b8c-8b9d-360a493374e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:47Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553),volume_type_id=e3cd00c8-3a4d-44e5-8bcd-9856ac8a8553)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Creating volume feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:47 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:47 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 1073741824 Apr 30 10:59:47 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:47 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-777a4c0e-60bb-43a4-b75d-031144db66ca" returned: 0 in 1.216s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-777a4c0e-60bb-43a4-b75d-031144db66ca" released by "delete_volume" :: held 2.141s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Created reservations ['fecbeea0-aeb3-4cbc-ae96-091df550cd1d', 'dc62dc3a-211a-4e56-9962-fe62100a75d2', 'fcf28f5a-f6ca-4256-8ece-b614d7aa811d', '1eddd6cd-01d0-4ce3-94d5-f0a42a2a6581'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:48 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:48 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:48 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 1073741824" returned: 0 in 0.955s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=128,cinder:UPDATE=128,cinder:DELETE=9,cinder:INSERT=34 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:59:48 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.662s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Deleted volume successfully. Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35d914fa-82e6-44ac-b4aa-c4b67d2eacca tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-777a4c0e-60bb-43a4-b75d-031144db66ca-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:48 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 Apr 30 10:59:48 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-299ab4ee-db4d-46d9-a9a2-08405379e20b-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-299ab4ee-db4d-46d9-a9a2-08405379e20b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "cinder-quobyte-299ab4ee-db4d-46d9-a9a2-08405379e20b" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-299ab4ee-db4d-46d9-a9a2-08405379e20b" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a63b7-f0f0-4be4-9425-5a771ef40882]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:49 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b Apr 30 10:59:49 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:49 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0" returned: 0 in 0.748s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=120,cinder:SELECT=125,cinder:INSERT=26,cinder:DELETE=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db156404-2c62-4f7e-a51e-eaaa07c52e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7be584a-19e2-4e41-8fbb-f66394f6c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Volume volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 (feb0d186-1cd5-4b8c-8b9d-360a493374e0): created successfully Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7be584a-19e2-4e41-8fbb-f66394f6c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (5596593f-313d-4483-acd8-3ef7c192c98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-02d7f03f-c6af-4298-8d6f-6d3a0f20cb56 tempest-GroupSnapshotsTest-1533913445 None] Created volume successfully. Apr 30 10:59:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3c7dd125-1337-49ad-9b2c-fa23eff45479 tempest-GroupSnapshotsTest-1533913445 None] Update group completed successfully. Apr 30 10:59:50 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b" returned: 0 in 0.806s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:50 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b Apr 30 10:59:50 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:50 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-299ab4ee-db4d-46d9-a9a2-08405379e20b" returned: 0 in 0.661s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-quobyte-299ab4ee-db4d-46d9-a9a2-08405379e20b" released by "delete_volume" :: held 1.518s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Created reservations ['72ec409c-2438-47c3-8303-54032804593e', 'b2b31ed9-7fe5-41aa-9760-78bc62d9d560', '7081b1ec-64e3-416e-bd27-cba97b94a88f', '1085768e-b3d6-4f3c-9e7e-f009c9737c13'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:50 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:50 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Flow 'volume_create_manager' (4361cf7a-2e92-486d-81af-4596ae7cf6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ac97d-50b9-49f3-974c-d6b891cea86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ac97d-50b9-49f3-974c-d6b891cea86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-808857221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98071e0d-c0a9-459a-9efe-c59e5737caae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf603d8619b346aaae43ca2b3a00c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:51Z,use_quota=True,user_id='c38f95cd881b420c8fb22179cca992c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf869c4-4fe7-4c7f-a747-7902166032ce),volume_type_id=4cf869c4-4fe7-4c7f-a747-7902166032ce)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353aa61b-c3b0-40c6-8faa-6030da8518d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353aa61b-c3b0-40c6-8faa-6030da8518d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa95a26c-210d-4643-9aa1-9644ea37a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa95a26c-210d-4643-9aa1-9644ea37a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98071e0d-c0a9-459a-9efe-c59e5737caae', 'volume_name': 'volume-98071e0d-c0a9-459a-9efe-c59e5737caae', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383faba9-299d-4e47-a92d-f0b60dd35ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383faba9-299d-4e47-a92d-f0b60dd35ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68218eca-5323-4fa5-9df1-36954e807391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Volume 98071e0d-c0a9-459a-9efe-c59e5737caae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98071e0d-c0a9-459a-9efe-c59e5737caae', 'volume_size': 1} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T08:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-808857221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98071e0d-c0a9-459a-9efe-c59e5737caae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf603d8619b346aaae43ca2b3a00c631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T08:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T08:59:51Z,use_quota=True,user_id='c38f95cd881b420c8fb22179cca992c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf869c4-4fe7-4c7f-a747-7902166032ce),volume_type_id=4cf869c4-4fe7-4c7f-a747-7902166032ce)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Creating volume 98071e0d-c0a9-459a-9efe-c59e5737caae {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 10:59:51 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:51 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae 1073741824 Apr 30 10:59:51 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-dc4eb309-3247-4047-b956-3cbe0b0edeee tempest-GroupSnapshotsTest-1533913445 None] Update group completed successfully. Apr 30 10:59:51 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.667s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Deleted volume successfully. Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8cfcae9-7499-4876-9c6e-020d90140429 tempest-AttachVolumeTestJSON-686146806 None] Lock "cinder-299ab4ee-db4d-46d9-a9a2-08405379e20b-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:51 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae 1073741824" returned: 0 in 0.890s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:51 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae Apr 30 10:59:51 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-764ce365-ce89-47fb-9e57-61a2cba55e86 tempest-GroupSnapshotsTest-1533913445 None] Update group completed successfully. Apr 30 10:59:52 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68218eca-5323-4fa5-9df1-36954e807391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98071e0d-c0a9-459a-9efe-c59e5737caae', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdfe724-aee5-4487-8882-a90d0d971d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 10:59:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Volume volume-98071e0d-c0a9-459a-9efe-c59e5737caae (98071e0d-c0a9-459a-9efe-c59e5737caae): created successfully Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdfe724-aee5-4487-8882-a90d0d971d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 10:59:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Flow 'volume_create_manager' (4361cf7a-2e92-486d-81af-4596ae7cf6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 10:59:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-faea51c8-5172-4529-b822-cba0191694eb tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Created volume successfully. Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:53 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:53 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b8d7f924-3465-4ae6-a830-da8f26b81a11 tempest-GroupSnapshotsTest-1533913445 None] Update group completed successfully. Apr 30 10:59:54 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.726s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:54 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d7bc69e0-7594-491e-a98d-806486070644 tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Retype volume completed successfully. Apr 30 10:59:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "cinder-98071e0d-c0a9-459a-9efe-c59e5737caae-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "cinder-98071e0d-c0a9-459a-9efe-c59e5737caae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "cinder-quobyte-98071e0d-c0a9-459a-9efe-c59e5737caae" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "cinder-quobyte-98071e0d-c0a9-459a-9efe-c59e5737caae" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d16cf-ec7e-453d-94ec-0e72a7b4cafe]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] GroupSnapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: creating. Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Group snapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: creating. {{(pid=84432) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Creating offline snapshot 7f0836b6-4c55-46af-9c48-db0d8eec36ef of volume 9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 10:59:55 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae Apr 30 10:59:55 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b18a1e7-1345-4934-bfc7-fd9195ea86d7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 10:59:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:55 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 Apr 30 10:59:55 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:56 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae" returned: 0 in 0.978s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:56 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae Apr 30 10:59:56 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:56 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" returned: 0 in 0.912s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:56 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef 1G Apr 30 10:59:56 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:56 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-98071e0d-c0a9-459a-9efe-c59e5737caae" returned: 0 in 0.721s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "cinder-quobyte-98071e0d-c0a9-459a-9efe-c59e5737caae" released by "delete_volume" :: held 1.859s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:56 devstack cinder-volume[84432]: WARNING cinder.quota [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:59:56 devstack cinder-volume[84432]: WARNING cinder.quota [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 10:59:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Created reservations ['59ab21b2-c8a1-4824-9c62-48fb3a0584f8', '1d1a7dec-17cc-4d6c-9fc8-bdde8960550c', '91ee16e1-16a0-482c-95dc-7021e8fd7cb4', '96b02813-d78c-4488-b8e9-df9f913172bd'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:57 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 10:59:57 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:57 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef 1G" returned: 0 in 0.931s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:57 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef Apr 30 10:59:57 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:57 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.830s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 10:59:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Deleted volume successfully. Apr 30 10:59:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2112fa9b-544b-4c6a-9069-6ac6f3d26b5f tempest-VolumeRetypeWithoutMigrationTest-2113614668 None] Lock "cinder-98071e0d-c0a9-459a-9efe-c59e5737caae-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 10:59:58 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:58 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef is being set with open permissions: ugo+rw: NotImplementedError Apr 30 10:59:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:58 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef Apr 30 10:59:58 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:58 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef" returned: 0 in 0.673s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:58 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info Apr 30 10:59:58 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 10:59:59 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Apr 30 10:59:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 10:59:59 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 10:59:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 10:59:59 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info Apr 30 10:59:59 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:00 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.info" returned: 0 in 0.652s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.746s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Creating offline snapshot e642cbaf-12b3-4c03-870b-8118a65078bb of volume feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e92f6a-bc12-4104-ad2e-4df079a45a9d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:00 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 Apr 30 11:00:00 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (e6530536-cf07-4801-85e6-113e37f4bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b762d3-b25d-4896-aafa-088b3c5bd642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b762d3-b25d-4896-aafa-088b3c5bd642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1373569777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce22f7b-5b21-452b-a876-3935950a8bd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:00Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4d04b7-f4a6-4359-9d76-65f57c706393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4d04b7-f4a6-4359-9d76-65f57c706393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c251caf-a875-4a8b-9a67-9df58d15fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c251caf-a875-4a8b-9a67-9df58d15fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce22f7b-5b21-452b-a876-3935950a8bd1', 'volume_name': 'volume-6ce22f7b-5b21-452b-a876-3935950a8bd1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25967f07-75ca-4217-a878-78d0f99307bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25967f07-75ca-4217-a878-78d0f99307bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb14f12b-24d6-483f-9078-57f436e370d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:00 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Volume 6ce22f7b-5b21-452b-a876-3935950a8bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce22f7b-5b21-452b-a876-3935950a8bd1', 'volume_size': 1} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:00 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0" returned: 0 in 0.854s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:01 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb 1G Apr 30 11:00:01 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:02 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb 1G" returned: 0 in 1.320s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:02 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb Apr 30 11:00:02 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:03 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb" returned: 0 in 0.737s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:03 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:00:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:03 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb Apr 30 11:00:03 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:03 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb" returned: 0 in 0.835s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:03 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info Apr 30 11:00:03 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:04 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:04 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:00:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:04 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info Apr 30 11:00:04 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:05 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.info" returned: 0 in 0.864s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.391s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.999s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1373569777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce22f7b-5b21-452b-a876-3935950a8bd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:00Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Creating volume 6ce22f7b-5b21-452b-a876-3935950a8bd1 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:05 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:05 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 1073741824 Apr 30 11:00:05 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9755042c-01d4-4971-8be3-776f9b349ab4 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: created successfully Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] group_snapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: deleting Apr 30 11:00:06 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:06 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] group_snapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: deleting {{(pid=84432) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" acquired by "delete_snapshot" :: waited 0.060s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-7f0836b6-4c55-46af-9c48-db0d8eec36ef" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-7f0836b6-4c55-46af-9c48-db0d8eec36ef" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Deleting offline snapshot 7f0836b6-4c55-46af-9c48-db0d8eec36ef of volume 9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] snapshot_file for this snap is: volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ee7e5-66ad-4a5c-9ee7-e4beb6efe948]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:06 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef Apr 30 11:00:06 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:07 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 1073741824" returned: 0 in 1.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:07 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 Apr 30 11:00:07 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:07 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.456s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:07 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef" returned: 0 in 1.364s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a671c-e734-406e-bf42-1fb2fb9fe266]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:08 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 Apr 30 11:00:08 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:08 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1" returned: 0 in 0.913s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] <== create_volume: return (2744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.749s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb14f12b-24d6-483f-9078-57f436e370d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce22f7b-5b21-452b-a876-3935950a8bd1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac70755-759e-42f7-88d9-855dda925415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Volume volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 (6ce22f7b-5b21-452b-a876-3935950a8bd1): created successfully Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac70755-759e-42f7-88d9-855dda925415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (e6530536-cf07-4801-85e6-113e37f4bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7fe66fa8-4673-448b-8747-dc197a03b24b tempest-VolumesTestJSON-525449257 None] Created volume successfully. Apr 30 11:00:08 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" returned: 0 in 0.846s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:08 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef Apr 30 11:00:08 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:09 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef" returned: 0 in 0.916s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:09 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef Apr 30 11:00:09 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (b04bb1e0-768b-433e-8122-8fb8985a01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7efc26-6eea-4af1-bea6-f93def5649b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7efc26-6eea-4af1-bea6-f93def5649b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2113617666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7bf36-306e-4b35-b687-02136dcdcced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:10Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f082b1-dce8-464c-9457-43cbddd5e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f082b1-dce8-464c-9457-43cbddd5e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fccb56-d766-4ddb-8f48-8384f291a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fccb56-d766-4ddb-8f48-8384f291a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e7bf36-306e-4b35-b687-02136dcdcced', 'volume_name': 'volume-05e7bf36-306e-4b35-b687-02136dcdcced', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f18ccb-9d53-478d-9d75-b022651be8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f18ccb-9d53-478d-9d75-b022651be8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8722833-1ed4-4e9c-b9a7-48ad08256fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Volume 05e7bf36-306e-4b35-b687-02136dcdcced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e7bf36-306e-4b35-b687-02136dcdcced', 'volume_size': 1} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2113617666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7bf36-306e-4b35-b687-02136dcdcced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:10Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Creating volume 05e7bf36-306e-4b35-b687-02136dcdcced {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:10 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:10 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced 1073741824 Apr 30 11:00:10 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:10 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60.7f0836b6-4c55-46af-9c48-db0d8eec36ef" returned: 0 in 1.161s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-7f0836b6-4c55-46af-9c48-db0d8eec36ef" released by "_delete_snapshot" :: held 4.531s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" released by "delete_snapshot" :: held 4.585s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-e642cbaf-12b3-4c03-870b-8118a65078bb" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-e642cbaf-12b3-4c03-870b-8118a65078bb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Deleting offline snapshot e642cbaf-12b3-4c03-870b-8118a65078bb of volume feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] snapshot_file for this snap is: volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[db72a3c6-2c5a-4950-846d-3531b5bb4167]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb Apr 30 11:00:11 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:11 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced 1073741824" returned: 0 in 1.340s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced Apr 30 11:00:11 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (a79e30e3-b89a-4c8d-9c3d-9f55ee3368f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7cca89-65f1-473b-8d31-71433ce2553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7cca89-65f1-473b-8d31-71433ce2553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1839685886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486934f9-adaf-4056-bf69-a5db6a44fbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:12Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffea32e-fb9f-4cb4-a79d-3d1b05fe9a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffea32e-fb9f-4cb4-a79d-3d1b05fe9a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ec74b-7677-4af4-ab28-a61cdb30b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ec74b-7677-4af4-ab28-a61cdb30b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486934f9-adaf-4056-bf69-a5db6a44fbe0', 'volume_name': 'volume-486934f9-adaf-4056-bf69-a5db6a44fbe0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303a387b-db36-42d8-a4c3-8bc6f675ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303a387b-db36-42d8-a4c3-8bc6f675ec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e8587-935c-4672-aeae-53cb9c5740e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:11 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Volume 486934f9-adaf-4056-bf69-a5db6a44fbe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486934f9-adaf-4056-bf69-a5db6a44fbe0', 'volume_size': 1} Apr 30 11:00:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:12 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb" returned: 0 in 1.074s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3efc6f-2276-4539-a68f-64906ff64004]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:12 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 Apr 30 11:00:12 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:12 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced" returned: 0 in 1.034s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1839685886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486934f9-adaf-4056-bf69-a5db6a44fbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:12Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Creating volume 486934f9-adaf-4056-bf69-a5db6a44fbe0 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:12 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8722833-1ed4-4e9c-b9a7-48ad08256fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e7bf36-306e-4b35-b687-02136dcdcced', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:12 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 1073741824 Apr 30 11:00:12 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dcadaf-1c8f-4047-a427-8ca8c405030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:12 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Volume volume-05e7bf36-306e-4b35-b687-02136dcdcced (05e7bf36-306e-4b35-b687-02136dcdcced): created successfully Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08dcadaf-1c8f-4047-a427-8ca8c405030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (b04bb1e0-768b-433e-8122-8fb8985a01de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f1a178a0-e852-4e2f-ab35-5eba5c0df64a tempest-VolumesTestJSON-525449257 None] Created volume successfully. Apr 30 11:00:13 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0" returned: 0 in 1.464s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:13 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb Apr 30 11:00:13 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (83f19586-c4f0-4a30-9ac4-78014b3d9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6ba4a-bca5-44bc-9e37-b9cfdfd6d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6ba4a-bca5-44bc-9e37-b9cfdfd6d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-120292833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb963bc-e66c-489b-a05e-a77a4973a076,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:14Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6e869a-5e29-4b0d-8054-51c922ac4053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6e869a-5e29-4b0d-8054-51c922ac4053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fda3c79-5913-4f2e-b18f-bd74f23952af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fda3c79-5913-4f2e-b18f-bd74f23952af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb963bc-e66c-489b-a05e-a77a4973a076', 'volume_name': 'volume-ffb963bc-e66c-489b-a05e-a77a4973a076', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5834d5dd-be9a-45cb-806b-63c81628028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5834d5dd-be9a-45cb-806b-63c81628028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e35638-a783-4ee8-9355-e9f3ac67585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:14 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Volume ffb963bc-e66c-489b-a05e-a77a4973a076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb963bc-e66c-489b-a05e-a77a4973a076', 'volume_size': 1} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:14 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 1073741824" returned: 0 in 1.977s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:14 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 Apr 30 11:00:14 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:15 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb" returned: 0 in 1.318s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:15 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb Apr 30 11:00:15 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:15 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0" returned: 0 in 0.877s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] <== create_volume: return (2919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.925s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-120292833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb963bc-e66c-489b-a05e-a77a4973a076,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de0a225c80624a078db6ff03782cb81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:14Z,use_quota=True,user_id='49f90475a2a947c7af8d0ddfdbb67aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Creating volume ffb963bc-e66c-489b-a05e-a77a4973a076 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:15 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e8587-935c-4672-aeae-53cb9c5740e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486934f9-adaf-4056-bf69-a5db6a44fbe0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e417a3-312d-4544-ae25-49a2424dbace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:15 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 1073741824 Apr 30 11:00:15 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Volume volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 (486934f9-adaf-4056-bf69-a5db6a44fbe0): created successfully Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e417a3-312d-4544-ae25-49a2424dbace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (a79e30e3-b89a-4c8d-9c3d-9f55ee3368f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c02db736-d9a9-46b3-9aae-0e2c032de9f7 tempest-VolumesListAdminTestJSON-945261133 None] Created volume successfully. Apr 30 11:00:15 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0.e642cbaf-12b3-4c03-870b-8118a65078bb" returned: 0 in 0.672s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-e642cbaf-12b3-4c03-870b-8118a65078bb" released by "_delete_snapshot" :: held 4.674s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" released by "delete_snapshot" :: held 4.702s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:15 devstack cinder-volume[84432]: WARNING cinder.quota [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1799971679 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1799971679, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:15 devstack cinder-volume[84432]: WARNING cinder.quota [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1799971679 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1799971679, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['8c995e6d-3237-4ff3-b78f-0b9f6ab69c43', '00be2be0-0d29-4232-8c4a-46851b8c73d7', 'e553e9d8-f4af-4700-8dfd-505a1b4d0fdd', 'caeb67f6-af0c-418e-b6cb-b3794791d8e3'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:15 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['b43a96ec-575d-4794-9b52-6e8ef0d5f416', '52eb4ac9-525b-4af0-9f8d-62ef4045b137', '9e761b89-d0b7-474e-9926-b54332591bb6', '91fbbfb5-6662-443d-831e-b15a557efa2f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5b27e666-bbca-4114-8f2a-c8110416f84e tempest-GroupSnapshotsTest-1533913445 None] group_snapshot f7c5518e-8912-4fd5-b011-337a2dff1b2c: deleted successfully Apr 30 11:00:16 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 1073741824" returned: 0 in 0.844s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:16 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 Apr 30 11:00:16 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (b5d394f8-c463-4dea-8bbc-a40e0cbb8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d25047-c31b-4701-82ee-7b067d6e17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" acquired by "delete_volume" :: waited 0.040s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d25047-c31b-4701-82ee-7b067d6e17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-376088205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a97f9-99cf-4729-8a1d-5b62cfa98047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:17Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93f17dc-26aa-4911-85ed-9b7f34e88a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93f17dc-26aa-4911-85ed-9b7f34e88a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f657e-eb5d-49aa-8d84-b5b9c4a598ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f657e-eb5d-49aa-8d84-b5b9c4a598ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01a97f9-99cf-4729-8a1d-5b62cfa98047', 'volume_name': 'volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d220fa24-4881-4127-be60-3faed21519d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d220fa24-4881-4127-be60-3faed21519d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6756c0f-6ca3-472c-b167-84a194f73cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:16 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Volume b01a97f9-99cf-4729-8a1d-5b62cfa98047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047', 'volume_size': 1} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fdbcd1-f21e-41a5-bb49-fb277da1c437]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:16 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 Apr 30 11:00:16 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:16 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076" returned: 0 in 0.663s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-376088205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a97f9-99cf-4729-8a1d-5b62cfa98047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:17Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Creating volume b01a97f9-99cf-4729-8a1d-5b62cfa98047 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:16 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:17 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 1073741824 Apr 30 11:00:17 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e35638-a783-4ee8-9355-e9f3ac67585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb963bc-e66c-489b-a05e-a77a4973a076', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16419d78-33ef-4771-8392-32a722ea5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:17 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Volume volume-ffb963bc-e66c-489b-a05e-a77a4973a076 (ffb963bc-e66c-489b-a05e-a77a4973a076): created successfully Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16419d78-33ef-4771-8392-32a722ea5d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Flow 'volume_create_manager' (83f19586-c4f0-4a30-9ac4-78014b3d9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7f80a601-8316-47d8-8b9d-ff6d97c9bd2e tempest-VolumesTestJSON-525449257 None] Created volume successfully. Apr 30 11:00:17 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" returned: 0 in 0.809s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:17 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60 Apr 30 11:00:17 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:17 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 1073741824" returned: 0 in 0.961s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:18 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 Apr 30 11:00:18 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-ffb963bc-e66c-489b-a05e-a77a4973a076-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "cinder-ffb963bc-e66c-489b-a05e-a77a4973a076-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-quobyte-ffb963bc-e66c-489b-a05e-a77a4973a076" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:18 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" returned: 0 in 0.763s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-ffb963bc-e66c-489b-a05e-a77a4973a076" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-9724d653-1338-41b7-9c0c-ddd1ee8a2d60" released by "delete_volume" :: held 1.690s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8863cc-f46f-49cb-902f-f859a7aae774]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbecf78-ac25-4388-8807-ec222da8adcc]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:18 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 Apr 30 11:00:18 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:18 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 Apr 30 11:00:18 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:18 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6756c0f-6ca3-472c-b167-84a194f73cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0af25-3336-4b9b-a396-787f9eb1e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:18 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Volume volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 (b01a97f9-99cf-4729-8a1d-5b62cfa98047): created successfully Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0af25-3336-4b9b-a396-787f9eb1e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (b5d394f8-c463-4dea-8bbc-a40e0cbb8191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c74970c6-b0b9-4780-af02-bfef5b3df8bc tempest-VolumesListAdminTestJSON-945261133 None] Created volume successfully. Apr 30 11:00:19 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076" returned: 0 in 0.785s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:19 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076 Apr 30 11:00:19 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:19 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0" returned: 0 in 0.877s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:19 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0 Apr 30 11:00:19 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (b1da17d5-758a-49a5-8a45-f0b1bd28b6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb9744c-2012-43b1-9f76-b6400d11e416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb9744c-2012-43b1-9f76-b6400d11e416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1634166161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff382880-f3a5-45c7-b900-aaa4a63a38e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:19Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c673012-de95-4449-8b2d-1fddc86168e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c673012-de95-4449-8b2d-1fddc86168e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6abd2d-71d5-4733-bb41-ceb3ff255539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6abd2d-71d5-4733-bb41-ceb3ff255539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff382880-f3a5-45c7-b900-aaa4a63a38e1', 'volume_name': 'volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7916dfae-b626-4607-916a-b75666e9eefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7916dfae-b626-4607-916a-b75666e9eefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4c6ffb-7a8e-4fe1-9be9-e86fc5a51de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Volume ff382880-f3a5-45c7-b900-aaa4a63a38e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1', 'volume_size': 1} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1634166161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff382880-f3a5-45c7-b900-aaa4a63a38e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a489bb028a88484ebb80cbe124d5a982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:19Z,use_quota=True,user_id='ba735b4c33d9406eaf866953046f22be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Creating volume ff382880-f3a5-45c7-b900-aaa4a63a38e1 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:19 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:19 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 1073741824 Apr 30 11:00:19 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:19 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ffb963bc-e66c-489b-a05e-a77a4973a076" returned: 0 in 0.598s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-ffb963bc-e66c-489b-a05e-a77a4973a076" released by "delete_volume" :: held 1.437s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:19 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Created reservations ['70451229-ebc1-4023-8323-c7b5b1671fe9', '61a434f5-487f-42f3-96b4-d4127c276a07', '413cc310-bfe7-4c98-9f5d-1ed33669f406', 'a8701985-5026-4ba8-a81b-120aea34b980'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:20 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:20 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:20 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-feb0d186-1cd5-4b8c-8b9d-360a493374e0" returned: 0 in 0.833s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-feb0d186-1cd5-4b8c-8b9d-360a493374e0" released by "delete_volume" :: held 1.840s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['ed45f40d-22fb-465b-8248-9b01f6952264'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:20 devstack cinder-volume[84432]: WARNING cinder.quota [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1799971679 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1799971679, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['4ee1814b-0d36-44e4-b186-2ba53a144a61', '99f4e0a4-ba97-4ab7-8825-25f39c4c5f0e', 'd1cfe525-7282-4d49-9e41-dee96ecfe5c0', 'e7d597d8-1b9d-4a99-8f99-4da983431dbc'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-05e7bf36-306e-4b35-b687-02136dcdcced-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "cinder-05e7bf36-306e-4b35-b687-02136dcdcced-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-quobyte-05e7bf36-306e-4b35-b687-02136dcdcced" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-05e7bf36-306e-4b35-b687-02136dcdcced" acquired by "delete_volume" :: waited 0.041s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:21 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ab4a2e-949f-4b1e-b8da-81efd78bb5ab]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 1073741824" returned: 0 in 1.475s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['caf27943-158d-49f1-9d0a-f838930685bf', '8ac16454-3032-4fcf-a3fd-507fcfb268cd', '63258db9-0a5f-4ab4-a438-3bf3dfe67562', 'b00aa0cc-be29-473d-be38-cdbf85394748'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:21 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced Apr 30 11:00:21 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:21 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 Apr 30 11:00:21 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:21 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.378s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:21 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Deleted volume successfully. Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e8da1a40-9b76-4ed3-a2e7-a3aa027e13a0 tempest-VolumesTestJSON-525449257 None] Lock "cinder-ffb963bc-e66c-489b-a05e-a77a4973a076-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:21 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:21 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:22 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced" returned: 0 in 1.265s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:22 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced Apr 30 11:00:22 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:22 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1" returned: 0 in 1.774s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] <== create_volume: return (3372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.375s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4c6ffb-7a8e-4fe1-9be9-e86fc5a51de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb9a919-62e2-4750-bdb2-92228e7dcd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Volume volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 (ff382880-f3a5-45c7-b900-aaa4a63a38e1): created successfully Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb9a919-62e2-4750-bdb2-92228e7dcd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Flow 'volume_create_manager' (b1da17d5-758a-49a5-8a45-f0b1bd28b6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e333e4d9-15da-4ba4-a27e-ecb2da8f775a tempest-VolumesListAdminTestJSON-945261133 None] Created volume successfully. Apr 30 11:00:23 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d992b0b1-7292-4636-a4fd-9cf33794ef29 tempest-GroupSnapshotsTest-1533913445 None] Delete group completed successfully. Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4916348b-4450-493b-8fa5-cd49b67f0b08 tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-591433982: creating Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4916348b-4450-493b-8fa5-cd49b67f0b08 tempest-GroupSnapshotsTest-1533913445 None] Group tempest-GroupSnapshotsTest-Group-591433982: created successfully Apr 30 11:00:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4916348b-4450-493b-8fa5-cd49b67f0b08 tempest-GroupSnapshotsTest-1533913445 None] Create group completed successfully. Apr 30 11:00:23 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-05e7bf36-306e-4b35-b687-02136dcdcced" returned: 0 in 1.425s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-05e7bf36-306e-4b35-b687-02136dcdcced" released by "delete_volume" :: held 2.796s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Created reservations ['739a3efa-b0af-4f89-9027-02798c2fb47f', '32676251-e4a4-41b8-942a-a89cdad8e502', '4180c36d-04aa-424b-8336-2f32e797ce7e', '2d1dcaec-97f5-4997-bb0a-754bcb96bd93'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:24 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:24 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-6ce22f7b-5b21-452b-a876-3935950a8bd1-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "cinder-6ce22f7b-5b21-452b-a876-3935950a8bd1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Acquiring lock "cinder-quobyte-6ce22f7b-5b21-452b-a876-3935950a8bd1" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-6ce22f7b-5b21-452b-a876-3935950a8bd1" acquired by "delete_volume" :: waited 0.053s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed322b-d17f-4dd4-9b2e-9fdfb2cb4a0e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:24 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 Apr 30 11:00:24 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:25 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.084s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Deleted volume successfully. Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-846fe4a3-3006-45a3-b7ea-eef3b3878f61 tempest-VolumesTestJSON-525449257 None] Lock "cinder-05e7bf36-306e-4b35-b687-02136dcdcced-delete_volume" released by "delete_volume" :: held 4.377s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Flow 'volume_create_manager' (4251760c-b4c3-41af-b52c-fd15e6868c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea51c768-5ae3-4c82-abfe-ffc8fb054854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea51c768-5ae3-4c82-abfe-ffc8fb054854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f72e00-f5ed-4964-b60c-fea45c76511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd9cb1e7772e4beab635966efd5077fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:25Z,use_quota=True,user_id='a986f5206f3a44bfbc269e5f90b66c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5f35e0-0a34-44b2-8448-5216494c84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5f35e0-0a34-44b2-8448-5216494c84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee1d480-5e75-4b8b-b551-0093d3ebd250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee1d480-5e75-4b8b-b551-0093d3ebd250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f72e00-f5ed-4964-b60c-fea45c76511f', 'volume_name': 'volume-13f72e00-f5ed-4964-b60c-fea45c76511f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e78cdd-fff4-4b97-89b3-20ef5ff94ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e78cdd-fff4-4b97-89b3-20ef5ff94ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204fffec-f8b8-4350-a00a-4722d5f85ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Volume 13f72e00-f5ed-4964-b60c-fea45c76511f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f72e00-f5ed-4964-b60c-fea45c76511f', 'volume_size': 1} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f72e00-f5ed-4964-b60c-fea45c76511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd9cb1e7772e4beab635966efd5077fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:25Z,use_quota=True,user_id='a986f5206f3a44bfbc269e5f90b66c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Creating volume 13f72e00-f5ed-4964-b60c-fea45c76511f {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:25 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:25 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f 1073741824 Apr 30 11:00:25 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (44a805bc-7dd8-48b9-8654-0e0a9714e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c6b768-276e-439a-9d29-cc04ae487366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c6b768-276e-439a-9d29-cc04ae487366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062611325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07f1767d-b14d-4ad0-ad4d-f0adc5008f17,host='devstack@QuobyteHD#QuobyteHD',id=213edb09-017d-4a67-b5f0-4fa8956e6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:25Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94da06bb-ee28-4a19-9cad-f4f641e8f7a4),volume_type_id=94da06bb-ee28-4a19-9cad-f4f641e8f7a4)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5acdd47-1009-464c-aa2f-b0f145a48826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5acdd47-1009-464c-aa2f-b0f145a48826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c200ce-8ecf-4bf2-99cc-571cb49bf854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c200ce-8ecf-4bf2-99cc-571cb49bf854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213edb09-017d-4a67-b5f0-4fa8956e6652', 'volume_name': 'volume-213edb09-017d-4a67-b5f0-4fa8956e6652', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586bda91-3237-429a-860b-8ec918211bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586bda91-3237-429a-860b-8ec918211bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed1a0e-6c7d-44b3-9e3b-5f2f4ece6ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:25 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Volume 213edb09-017d-4a67-b5f0-4fa8956e6652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213edb09-017d-4a67-b5f0-4fa8956e6652', 'volume_size': 1} Apr 30 11:00:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:26 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1" returned: 0 in 1.367s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:26 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1 Apr 30 11:00:26 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:26 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f 1073741824" returned: 0 in 1.021s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:26 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ce22f7b-5b21-452b-a876-3935950a8bd1" returned: 0 in 0.683s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "cinder-quobyte-6ce22f7b-5b21-452b-a876-3935950a8bd1" released by "delete_volume" :: held 2.134s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Created reservations ['96778451-e4aa-4cfa-9e60-13fff967d2b3', '0458d9f1-d086-4926-b9ae-7d81405d5b17', '3bcd140c-9095-4547-89eb-2570bdbb744c', '51035595-7712-490b-afb1-03cc5a6e4c5b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:26 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f Apr 30 11:00:26 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:27 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:27 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:27 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f" returned: 0 in 0.624s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07f1767d-b14d-4ad0-ad4d-f0adc5008f17,created_at=2026-04-30T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062611325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07f1767d-b14d-4ad0-ad4d-f0adc5008f17,host='devstack@QuobyteHD#QuobyteHD',id=213edb09-017d-4a67-b5f0-4fa8956e6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9aff33203430c9705bd2617d84b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:25Z,use_quota=True,user_id='a821956096044767b07844bbe95e45f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94da06bb-ee28-4a19-9cad-f4f641e8f7a4),volume_type_id=94da06bb-ee28-4a19-9cad-f4f641e8f7a4)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Creating volume 213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:27 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:27 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 1073741824 Apr 30 11:00:27 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204fffec-f8b8-4350-a00a-4722d5f85ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f72e00-f5ed-4964-b60c-fea45c76511f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc780aa-ba93-4992-96ec-1d431b3f7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:27 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.618s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:27 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Deleted volume successfully. Apr 30 11:00:28 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 1073741824" returned: 0 in 0.800s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:30 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Volume volume-13f72e00-f5ed-4964-b60c-fea45c76511f (13f72e00-f5ed-4964-b60c-fea45c76511f): created successfully Apr 30 11:00:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc780aa-ba93-4992-96ec-1d431b3f7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Flow 'volume_create_manager' (4251760c-b4c3-41af-b52c-fd15e6868c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90c42fa8-7565-4d52-b9f6-e270a71c2c7d tempest-VolumesTestJSON-525449257 None] Lock "cinder-6ce22f7b-5b21-452b-a876-3935950a8bd1-delete_volume" released by "delete_volume" :: held 6.431s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-46874975-8553-4958-b2c5-5e88e999eab4 tempest-VolumesListAdminTestJSON-1785878522 None] Created volume successfully. Apr 30 11:00:32 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 Apr 30 11:00:32 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Acquiring lock "cinder-13f72e00-f5ed-4964-b60c-fea45c76511f-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "cinder-13f72e00-f5ed-4964-b60c-fea45c76511f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Acquiring lock "cinder-quobyte-13f72e00-f5ed-4964-b60c-fea45c76511f" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "cinder-quobyte-13f72e00-f5ed-4964-b60c-fea45c76511f" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e0fbd-5e1a-4cdf-a840-4b6b149a966b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-ff382880-f3a5-45c7-b900-aaa4a63a38e1-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-ff382880-f3a5-45c7-b900-aaa4a63a38e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:32 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f Apr 30 11:00:32 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-quobyte-ff382880-f3a5-45c7-b900-aaa4a63a38e1" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-ff382880-f3a5-45c7-b900-aaa4a63a38e1" acquired by "delete_volume" :: waited 0.046s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1932f38-2eda-462c-a616-905006c421a3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:32 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 Apr 30 11:00:32 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:33 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652" returned: 0 in 0.971s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] <== create_volume: return (5707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.710s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed1a0e-6c7d-44b3-9e3b-5f2f4ece6ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213edb09-017d-4a67-b5f0-4fa8956e6652', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99563299-cd3a-408d-9ebf-e0b42deac24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Volume volume-213edb09-017d-4a67-b5f0-4fa8956e6652 (213edb09-017d-4a67-b5f0-4fa8956e6652): created successfully Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99563299-cd3a-408d-9ebf-e0b42deac24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Flow 'volume_create_manager' (44a805bc-7dd8-48b9-8654-0e0a9714e123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e21f4f22-346f-45d5-8a23-dfb365ccc105 tempest-GroupSnapshotsTest-1533913445 None] Created volume successfully. Apr 30 11:00:33 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f" returned: 0 in 1.020s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:33 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f Apr 30 11:00:33 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:33 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1" returned: 0 in 0.879s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:33 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1 Apr 30 11:00:33 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] GroupSnapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: creating. Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Group snapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: creating. {{(pid=84432) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Creating offline snapshot dd68bde8-8897-4041-b7ab-5c6f0b0184d7 of volume 213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dda140-08d3-4f61-94ab-0a8b48649152]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:34 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 Apr 30 11:00:34 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:34 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-13f72e00-f5ed-4964-b60c-fea45c76511f" returned: 0 in 0.927s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "cinder-quobyte-13f72e00-f5ed-4964-b60c-fea45c76511f" released by "delete_volume" :: held 2.016s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:34 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff382880-f3a5-45c7-b900-aaa4a63a38e1" returned: 0 in 0.894s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Created reservations ['b59ae5ea-7474-41a4-81b3-0fe1637e45bb', '775379d6-0fca-4ea7-acf8-f2e5f65332cb', '3ad18fdb-1b2b-4425-897e-c1efeeeaf898', 'e8741bad-dc7e-4dc6-8b86-97f158863b05'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-ff382880-f3a5-45c7-b900-aaa4a63a38e1" released by "delete_volume" :: held 1.865s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:34 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:34 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Created reservations ['bed47fdd-8c4e-49fb-a430-d81ed9c77da2', '28a29753-6a09-40bc-9304-863a8f70bc0b', '380b383a-a0b3-429d-8234-ba7e03655222', 'a4748975-c8eb-4f33-bfbd-559b7196ec0f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:34 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:34 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-b01a97f9-99cf-4729-8a1d-5b62cfa98047-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-b01a97f9-99cf-4729-8a1d-5b62cfa98047-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-quobyte-b01a97f9-99cf-4729-8a1d-5b62cfa98047" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-b01a97f9-99cf-4729-8a1d-5b62cfa98047" acquired by "delete_volume" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b37503-ead6-4afc-b8e2-da497e2252ea]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:35 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652" returned: 0 in 1.377s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:35 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 1G Apr 30 11:00:35 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:35 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 Apr 30 11:00:35 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:35 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.067s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Deleted volume successfully. Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55db1d96-5161-43c6-91f0-130d9a16e5d4 tempest-VolumesListAdminTestJSON-1785878522 None] Lock "cinder-13f72e00-f5ed-4964-b60c-fea45c76511f-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:35 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.938s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Deleted volume successfully. Apr 30 11:00:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-64d57ccc-ae35-4014-a1e7-0de1ca7bdf30 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-ff382880-f3a5-45c7-b900-aaa4a63a38e1-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:36 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047" returned: 0 in 1.039s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:36 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047 Apr 30 11:00:36 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:36 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 1G" returned: 0 in 1.300s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213edb09-017d-4a67-b5f0-4fa8956e6652 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:36 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213edb09-017d-4a67-b5f0-4fa8956e6652 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 Apr 30 11:00:36 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Flow 'volume_create_manager' (0705aef9-7646-4324-8510-3b310684ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd191c70-dc47-43cf-bbbb-822ed5a7714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd191c70-dc47-43cf-bbbb-822ed5a7714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1664014533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf01515-0f64-4e5a-9323-4a44048896b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351331e49f424808b7604b5affe03d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:37Z,use_quota=True,user_id='b11d0e19b7304908923410291ed0f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a936eeb5-b9bc-4dfb-91b8-03139184e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a936eeb5-b9bc-4dfb-91b8-03139184e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5cccf-e9fb-410d-bb1d-938492424496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5cccf-e9fb-410d-bb1d-938492424496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf01515-0f64-4e5a-9323-4a44048896b7', 'volume_name': 'volume-6cf01515-0f64-4e5a-9323-4a44048896b7', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95167786-b51d-4e1e-8069-6158232c306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95167786-b51d-4e1e-8069-6158232c306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb6cc52-4b0a-44d4-aa95-321f997adfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Volume 6cf01515-0f64-4e5a-9323-4a44048896b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf01515-0f64-4e5a-9323-4a44048896b7', 'volume_size': 1} Apr 30 11:00:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:37 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b01a97f9-99cf-4729-8a1d-5b62cfa98047" returned: 0 in 0.782s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-b01a97f9-99cf-4729-8a1d-5b62cfa98047" released by "delete_volume" :: held 1.877s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Created reservations ['81f21c23-cd75-4af5-b734-ccba6d2f7306', '46bd1959-7bb9-4aa7-b686-77460f7a8ce2', '95dc7a34-16fa-4558-b908-7808b6da26c7', 'ca9ba3d6-eba0-40cf-95d1-7db887eb0f55'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:37 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:37 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:37 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-213edb09-017d-4a67-b5f0-4fa8956e6652 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:37 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:37 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 Apr 30 11:00:37 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-486934f9-adaf-4056-bf69-a5db6a44fbe0-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-486934f9-adaf-4056-bf69-a5db6a44fbe0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "cinder-quobyte-486934f9-adaf-4056-bf69-a5db6a44fbe0" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-486934f9-adaf-4056-bf69-a5db6a44fbe0" acquired by "delete_volume" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a11ec-89cb-4266-ba1f-e8313b784887]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:37 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 Apr 30 11:00:37 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:37 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.764s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Deleted volume successfully. Apr 30 11:00:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-72449af3-b3af-482e-9bad-864e950265d3 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-b01a97f9-99cf-4729-8a1d-5b62cfa98047-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:38 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:38 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info Apr 30 11:00:38 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:38 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0" returned: 0 in 0.816s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:38 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0 Apr 30 11:00:38 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:38 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info" returned: 0 in 0.739s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:38 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:00:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:38 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info Apr 30 11:00:38 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:39 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-486934f9-adaf-4056-bf69-a5db6a44fbe0" returned: 0 in 0.636s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-quobyte-486934f9-adaf-4056-bf69-a5db6a44fbe0" released by "delete_volume" :: held 1.532s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Created reservations ['b4493cd1-7f7f-4d48-a2ef-a4c0ba5d0fd0', 'fb838e5f-5da7-4bf8-9019-a1ddc0710777', 'b35d361d-318d-4edc-9915-c491fe3f5ec5', '6a2d58a3-7d43-490f-a20c-9928ce1a7db3'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:39 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:39 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:39 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.info" returned: 0 in 0.697s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.659s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.797s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1664014533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf01515-0f64-4e5a-9323-4a44048896b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351331e49f424808b7604b5affe03d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:37Z,use_quota=True,user_id='b11d0e19b7304908923410291ed0f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Creating volume 6cf01515-0f64-4e5a-9323-4a44048896b7 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:39 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:39 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 1073741824 Apr 30 11:00:39 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-37133054-ce6d-45e8-a2ea-c03a2b75ea40 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: created successfully Apr 30 11:00:39 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.650s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Deleted volume successfully. Apr 30 11:00:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8c82c0a-33d5-4c25-a4c5-fc190643f0e2 tempest-VolumesListAdminTestJSON-945261133 None] Lock "cinder-486934f9-adaf-4056-bf69-a5db6a44fbe0-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: deleting Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: deleting {{(pid=84432) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-dd68bde8-8897-4041-b7ab-5c6f0b0184d7" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-dd68bde8-8897-4041-b7ab-5c6f0b0184d7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Deleting offline snapshot dd68bde8-8897-4041-b7ab-5c6f0b0184d7 of volume 213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] snapshot_file for this snap is: volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec26300e-974f-41b6-bc88-365b600fb112]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:40 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 1073741824" returned: 0 in 1.108s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:40 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 Apr 30 11:00:40 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:40 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 Apr 30 11:00:40 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:41 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7" returned: 0 in 0.821s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb6cc52-4b0a-44d4-aa95-321f997adfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf01515-0f64-4e5a-9323-4a44048896b7', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d52ac27-25bb-4820-a2c2-415ac5e22321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:41 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Volume volume-6cf01515-0f64-4e5a-9323-4a44048896b7 (6cf01515-0f64-4e5a-9323-4a44048896b7): created successfully Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d52ac27-25bb-4820-a2c2-415ac5e22321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Flow 'volume_create_manager' (0705aef9-7646-4324-8510-3b310684ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5ad98782-f3ae-440b-8538-95385428853e tempest-ServersNegativeTestJSON-265951813 None] Created volume successfully. Apr 30 11:00:41 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7" returned: 0 in 1.041s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-213edb09-017d-4a67-b5f0-4fa8956e6652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d6834b-f46e-4bde-8339-a7cd8ea01987]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:41 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 Apr 30 11:00:41 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e923fce6-2c3c-4e28-b535-80aed07f0437 tempest-BackendsCapabilitiesAdminTestsJSON-1670275854 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7126998901367, 'free_capacity_gb': 1775.7126998901367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84432) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 30 11:00:42 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652" returned: 0 in 0.953s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:42 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 Apr 30 11:00:42 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1936bdb1-85c3-4b8a-aac8-73fe00e81912 tempest-BackendsCapabilitiesAdminTestsJSON-1670275854 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7126998901367, 'free_capacity_gb': 1775.7126998901367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84432) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 30 11:00:43 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7" returned: 0 in 0.874s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:43 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7 Apr 30 11:00:43 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Flow 'volume_create_manager' (f4aba607-0e51-4fdf-b570-f22add5f515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2122a3e5-7063-43e9-87af-6da5351566dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2122a3e5-7063-43e9-87af-6da5351566dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-750550160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e1075-5672-450f-acb2-f880928bffbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351331e49f424808b7604b5affe03d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:44Z,use_quota=True,user_id='b11d0e19b7304908923410291ed0f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad1a8a1-ed85-4a7e-90c4-d014574906e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad1a8a1-ed85-4a7e-90c4-d014574906e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7af001-da34-437e-9bac-40a4467e32fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7af001-da34-437e-9bac-40a4467e32fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477e1075-5672-450f-acb2-f880928bffbe', 'volume_name': 'volume-477e1075-5672-450f-acb2-f880928bffbe', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e77a2f5-5139-45ba-8836-7851c726f5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e77a2f5-5139-45ba-8836-7851c726f5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3cde61-c2e0-425e-be0a-9f022fcd96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Volume 477e1075-5672-450f-acb2-f880928bffbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477e1075-5672-450f-acb2-f880928bffbe', 'volume_size': 1} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-750550160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e1075-5672-450f-acb2-f880928bffbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351331e49f424808b7604b5affe03d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:44Z,use_quota=True,user_id='b11d0e19b7304908923410291ed0f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Creating volume 477e1075-5672-450f-acb2-f880928bffbe {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:43 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:43 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe 1073741824 Apr 30 11:00:43 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:44 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652.dd68bde8-8897-4041-b7ab-5c6f0b0184d7" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-dd68bde8-8897-4041-b7ab-5c6f0b0184d7" released by "_delete_snapshot" :: held 3.784s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" released by "delete_snapshot" :: held 3.833s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:44 devstack cinder-volume[84432]: WARNING cinder.quota [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1423197379 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1423197379, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:44 devstack cinder-volume[84432]: WARNING cinder.quota [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1423197379 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1423197379, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['58e3d913-cd7a-4d99-bcd3-adb1a651aa40', '698d0827-2747-4a29-9439-36ddf1812019', '9061f6c0-f48c-415a-8bbb-06722ed9c239', 'f4043d67-243f-4220-a89d-f35b4f627d41'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-66b484d8-3d6b-4a68-8fc2-34eb31dad681 tempest-GroupSnapshotsTest-1533913445 None] group_snapshot e69fbcc2-e000-4eaf-a03b-ef3d188cd9be: deleted successfully Apr 30 11:00:44 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe 1073741824" returned: 0 in 1.021s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:45 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe Apr 30 11:00:45 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[92878d1b-5feb-424a-a2bc-7754fef196f0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:45 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 Apr 30 11:00:45 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:45 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe" returned: 0 in 0.970s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3cde61-c2e0-425e-be0a-9f022fcd96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477e1075-5672-450f-acb2-f880928bffbe', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dbb99e-b1a3-45da-bdc1-d23323aaf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Volume volume-477e1075-5672-450f-acb2-f880928bffbe (477e1075-5672-450f-acb2-f880928bffbe): created successfully Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dbb99e-b1a3-45da-bdc1-d23323aaf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Flow 'volume_create_manager' (f4aba607-0e51-4fdf-b570-f22add5f515f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4faf58f7-51fe-45b3-80e0-4dfb79d0bf08 tempest-ServersNegativeTestJSON-265951813 None] Created volume successfully. Apr 30 11:00:46 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652" returned: 0 in 1.141s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:46 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652 Apr 30 11:00:46 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:47 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-213edb09-017d-4a67-b5f0-4fa8956e6652" returned: 0 in 0.640s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Lock "cinder-quobyte-213edb09-017d-4a67-b5f0-4fa8956e6652" released by "delete_volume" :: held 1.874s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['e8bd43c1-1e80-42fb-b290-4f10a83736bd'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:47 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1423197379 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1423197379, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Created reservations ['5c6d6fb1-2d1a-43ba-8868-e9d458c0d2db', '48576ad6-4475-4500-9e57-f49934c858ff', '69158c23-5a3e-4724-9551-cabc129d66d2', 'daf6c321-170c-49f9-ae44-822a043e1762'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:47 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:47 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "cinder-477e1075-5672-450f-acb2-f880928bffbe-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-477e1075-5672-450f-acb2-f880928bffbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "cinder-quobyte-477e1075-5672-450f-acb2-f880928bffbe" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-quobyte-477e1075-5672-450f-acb2-f880928bffbe" acquired by "delete_volume" :: waited 0.045s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22bebb4-39e5-42be-85d4-3f2a37daa0f4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:48 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe Apr 30 11:00:48 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:48 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.020s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a5d845f1-4d8c-4734-b818-9d33d0b7e76c tempest-GroupSnapshotsTest-1533913445 None] Delete group completed successfully. Apr 30 11:00:48 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe" returned: 0 in 0.944s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:48 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe Apr 30 11:00:48 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:49 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-477e1075-5672-450f-acb2-f880928bffbe" returned: 0 in 0.781s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-quobyte-477e1075-5672-450f-acb2-f880928bffbe" released by "delete_volume" :: held 1.805s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=135,cinder:UPDATE=161,cinder:INSERT=42,cinder:DELETE=12 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=149,cinder:UPDATE=179,cinder:DELETE=9,cinder:INSERT=34 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Created reservations ['e79654df-a5b5-4ca8-aa78-dfc1c7495da3', 'da782f35-023f-4265-b938-943d6be1e21e', 'fe010835-e83c-45de-94f2-7ede84cad46a', '1bcc5fe5-1a2e-4b6d-80fd-619b5bec38eb'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:49 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:49 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "cinder-6cf01515-0f64-4e5a-9323-4a44048896b7-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-6cf01515-0f64-4e5a-9323-4a44048896b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "cinder-quobyte-6cf01515-0f64-4e5a-9323-4a44048896b7" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-quobyte-6cf01515-0f64-4e5a-9323-4a44048896b7" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e0cd8c-517a-40a9-9190-ab1bcbe59bd3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:50 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 Apr 30 11:00:50 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:50 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.753s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Deleted volume successfully. Apr 30 11:00:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c9aebff7-6812-4820-8a04-62d8509cc4e6 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-477e1075-5672-450f-acb2-f880928bffbe-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:51 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7" returned: 0 in 1.072s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:51 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7 Apr 30 11:00:51 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:52 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6cf01515-0f64-4e5a-9323-4a44048896b7" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-quobyte-6cf01515-0f64-4e5a-9323-4a44048896b7" released by "delete_volume" :: held 1.804s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Created reservations ['851e9306-ce64-47c5-892d-485d55be394d', '62c3ab5e-6ca4-4543-895b-7c86601f9f94', 'e640488d-69a6-4978-a4e5-80b44a8034eb', '917a214a-48dd-45a5-9369-8aa318d18392'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:52 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:52 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:53 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Deleted volume successfully. Apr 30 11:00:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9520b298-b013-4d29-a415-784179d10647 tempest-ServersNegativeTestJSON-265951813 None] Lock "cinder-6cf01515-0f64-4e5a-9323-4a44048896b7-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-51968488-bb63-40b0-8a94-19f003fe76b0 tempest-GroupSnapshotsV319Test-1876097681 None] Group tempest-GroupSnapshotsV319Test-Group-448915672: creating Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Flow 'volume_create_manager' (451796a6-13c2-43c1-a787-b98b3e9055cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d257e752-5794-4ffd-af4a-bc3fb4250d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d257e752-5794-4ffd-af4a-bc3fb4250d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1203150616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3be648-1679-4d59-b780-dcfd0034077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1e5ff9775e47bf8eca4cf81fdf0e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:55Z,use_quota=True,user_id='bfbfff6a7b6449b4a2a0e17860f6f6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df431c07-4c28-4c1d-b3fb-6cf6cc8d2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df431c07-4c28-4c1d-b3fb-6cf6cc8d2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c131c-69d8-424e-829c-50b6c498ec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c131c-69d8-424e-829c-50b6c498ec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3be648-1679-4d59-b780-dcfd0034077d', 'volume_name': 'volume-2c3be648-1679-4d59-b780-dcfd0034077d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492dfa62-f791-4223-8d47-835301a04d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492dfa62-f791-4223-8d47-835301a04d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c3d2a3-705b-4728-9573-7f1cf3349078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:55 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Volume 2c3be648-1679-4d59-b780-dcfd0034077d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3be648-1679-4d59-b780-dcfd0034077d', 'volume_size': 1} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1203150616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3be648-1679-4d59-b780-dcfd0034077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1e5ff9775e47bf8eca4cf81fdf0e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:55Z,use_quota=True,user_id='bfbfff6a7b6449b4a2a0e17860f6f6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Creating volume 2c3be648-1679-4d59-b780-dcfd0034077d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:55 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-51968488-bb63-40b0-8a94-19f003fe76b0 tempest-GroupSnapshotsV319Test-1876097681 None] Group tempest-GroupSnapshotsV319Test-Group-448915672: created successfully Apr 30 11:00:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-51968488-bb63-40b0-8a94-19f003fe76b0 tempest-GroupSnapshotsV319Test-1876097681 None] Create group completed successfully. Apr 30 11:00:55 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d 1073741824 Apr 30 11:00:55 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:56 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d 1073741824" returned: 0 in 0.949s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:56 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d Apr 30 11:00:56 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Flow 'volume_create_manager' (25f29382-a741-454d-92c8-972d2de0e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24893f41-0ae1-4d73-ae59-913f5735af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24893f41-0ae1-4d73-ae59-913f5735af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676297098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11cd633d-fb92-4676-a949-e31610eb6bd3,host='devstack@QuobyteHD#QuobyteHD',id=efaaf4e2-f6b8-47e2-bce9-4df84af43046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3ec98e9a3e4741a6d10499c00a565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:57Z,use_quota=True,user_id='3499ba9865694bd79a25cc60845b64f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e4ce80c-3f43-4ad1-8e65-af6622d6145c),volume_type_id=8e4ce80c-3f43-4ad1-8e65-af6622d6145c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b364980-ded6-41a4-8d74-727561193840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b364980-ded6-41a4-8d74-727561193840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7361fa-0418-4325-9240-2e09c2f0ebfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7361fa-0418-4325-9240-2e09c2f0ebfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efaaf4e2-f6b8-47e2-bce9-4df84af43046', 'volume_name': 'volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a651b7-81e6-4277-8955-4a0bfd5b17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a651b7-81e6-4277-8955-4a0bfd5b17c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a154688d-190c-4206-83e2-6f9d2fca63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Volume efaaf4e2-f6b8-47e2-bce9-4df84af43046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046', 'volume_size': 1} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:57 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d" returned: 0 in 0.754s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11cd633d-fb92-4676-a949-e31610eb6bd3,created_at=2026-04-30T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676297098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11cd633d-fb92-4676-a949-e31610eb6bd3,host='devstack@QuobyteHD#QuobyteHD',id=efaaf4e2-f6b8-47e2-bce9-4df84af43046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3ec98e9a3e4741a6d10499c00a565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:00:57Z,use_quota=True,user_id='3499ba9865694bd79a25cc60845b64f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e4ce80c-3f43-4ad1-8e65-af6622d6145c),volume_type_id=8e4ce80c-3f43-4ad1-8e65-af6622d6145c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Creating volume efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:00:57 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c3d2a3-705b-4728-9573-7f1cf3349078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3be648-1679-4d59-b780-dcfd0034077d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71df45c-a859-4023-99f7-7fae4401a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:57 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 1073741824 Apr 30 11:00:57 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Volume volume-2c3be648-1679-4d59-b780-dcfd0034077d (2c3be648-1679-4d59-b780-dcfd0034077d): created successfully Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71df45c-a859-4023-99f7-7fae4401a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Flow 'volume_create_manager' (451796a6-13c2-43c1-a787-b98b3e9055cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-26a5692a-43ee-4188-829d-575fd97d49dd tempest-AbsoluteLimitsTests-1935587342 None] Created volume successfully. Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Acquiring lock "cinder-2c3be648-1679-4d59-b780-dcfd0034077d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "cinder-2c3be648-1679-4d59-b780-dcfd0034077d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Acquiring lock "cinder-quobyte-2c3be648-1679-4d59-b780-dcfd0034077d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "cinder-quobyte-2c3be648-1679-4d59-b780-dcfd0034077d" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e820a-b6bc-4722-85f6-f380da7fc746]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:58 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d Apr 30 11:00:58 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:58 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 1073741824" returned: 0 in 1.046s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:58 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 Apr 30 11:00:58 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:58 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d" returned: 0 in 0.914s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:58 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d Apr 30 11:00:58 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:59 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046" returned: 0 in 0.685s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a154688d-190c-4206-83e2-6f9d2fca63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31569069-ef2c-4585-9071-59e4714eb9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:00:59 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Volume volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 (efaaf4e2-f6b8-47e2-bce9-4df84af43046): created successfully Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31569069-ef2c-4585-9071-59e4714eb9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Flow 'volume_create_manager' (25f29382-a741-454d-92c8-972d2de0e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:00:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-418ae410-2253-4301-b968-5229dd18ca11 tempest-GroupSnapshotsV319Test-1876097681 None] Created volume successfully. Apr 30 11:00:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] GroupSnapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: creating. Apr 30 11:00:59 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2c3be648-1679-4d59-b780-dcfd0034077d" returned: 0 in 0.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Group snapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: creating. {{(pid=84432) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "cinder-quobyte-2c3be648-1679-4d59-b780-dcfd0034077d" released by "delete_volume" :: held 1.753s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Creating offline snapshot bc57f8da-bb54-4cc9-84d9-106d426dc533 of volume efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[af586ed2-89cd-4809-8d96-84d1ac1e3c97]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Created reservations ['7058ed96-196c-4290-9b5e-afb92d14e4df', 'abf30f93-13bf-4c85-8dcc-a64413172ee2', 'cb20b80a-70b3-49bc-b597-c83dbeb7e0cc', 'ec6e34cd-39fe-4ab1-9a2b-8d285e3e8ca9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:00:59 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 Apr 30 11:00:59 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:00:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:59 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:00:59 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:00 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.964s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:00 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:00 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Deleted volume successfully. Apr 30 11:01:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-09f38235-0855-45f5-8cfa-10f018b25631 tempest-AbsoluteLimitsTests-1935587342 None] Lock "cinder-2c3be648-1679-4d59-b780-dcfd0034077d-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:01 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046" returned: 0 in 1.285s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:01 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 1G Apr 30 11:01:01 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:01 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 1G" returned: 0 in 0.954s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:02 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 Apr 30 11:01:02 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:02 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:02 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:01:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:02 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 Apr 30 11:01:02 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:03 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533" returned: 0 in 0.702s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:03 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info Apr 30 11:01:03 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:04 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info" returned: 0 in 0.665s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:04 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:01:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:04 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info Apr 30 11:01:04 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:04 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.info" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.198s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-28923556-6ff2-4d16-a424-aa5b6f0760ef tempest-GroupSnapshotsV319Test-1876097681 None] group_snapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: created successfully Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:06 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:06 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] group_snapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: deleting Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] group_snapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: deleting {{(pid=84432) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "cinder-quobyte-bc57f8da-bb54-4cc9-84d9-106d426dc533" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-bc57f8da-bb54-4cc9-84d9-106d426dc533" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Deleting offline snapshot bc57f8da-bb54-4cc9-84d9-106d426dc533 of volume efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] snapshot_file for this snap is: volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0d3de-ddee-4476-a8cb-9295f06a5098]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:06 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 Apr 30 11:01:06 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:06 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.908s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (e713a579-0329-4764-ad4d-62b7766f8ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d9a781-fe87-4480-8657-93d1a8799740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d9a781-fe87-4480-8657-93d1a8799740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1154149945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0dba9a3d744d5189f1f7aa7ca82417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:07Z,use_quota=True,user_id='fbe21476e67d48509a7b94298c571f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ddd2b6-4ca4-4b5f-981f-4773d42928b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ddd2b6-4ca4-4b5f-981f-4773d42928b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45058aff-7b84-4747-9a63-63e6d88c228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45058aff-7b84-4747-9a63-63e6d88c228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0', 'volume_name': 'volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13200ff5-8c74-4a14-b27e-3a06c674fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13200ff5-8c74-4a14-b27e-3a06c674fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f16fac7-bff2-41c5-91a9-89c0a74d4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0', 'volume_size': 1} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1154149945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0dba9a3d744d5189f1f7aa7ca82417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:07Z,use_quota=True,user_id='fbe21476e67d48509a7b94298c571f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Creating volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:07 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:07 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 1073741824 Apr 30 11:01:07 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:07 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533" returned: 0 in 1.009s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bc51a-2708-41f8-a835-a1386f65ccaf]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:07 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 Apr 30 11:01:07 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:08 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 1073741824" returned: 0 in 1.042s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:08 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 Apr 30 11:01:08 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:08 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046" returned: 0 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:08 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 Apr 30 11:01:08 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:08 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" returned: 0 in 0.663s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f16fac7-bff2-41c5-91a9-89c0a74d4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7bc4d-c0f2-4333-bc19-c29ee42d0b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Volume volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 (cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0): created successfully Apr 30 11:01:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7bc4d-c0f2-4333-bc19-c29ee42d0b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (e713a579-0329-4764-ad4d-62b7766f8ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-31ddf0ab-2892-4f65-984d-693daf8eb71d tempest-VolumesDeleteCascade-1587105418 None] Created volume successfully. Apr 30 11:01:09 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533" returned: 0 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:09 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533 Apr 30 11:01:09 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Creating offline snapshot d1b68dc2-4900-4812-b9f5-6185bce2cde3 of volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbe400-2431-4452-a00c-e9d3ffd65e68]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:09 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 Apr 30 11:01:09 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:10 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046.bc57f8da-bb54-4cc9-84d9-106d426dc533" returned: 0 in 0.739s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-bc57f8da-bb54-4cc9-84d9-106d426dc533" released by "_delete_snapshot" :: held 3.673s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" released by "delete_snapshot" :: held 3.702s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:10 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1629540296 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1629540296, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:01:10 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1629540296 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1629540296, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] Created reservations ['9709c4ac-5aa6-4f2a-acd2-e5be9851517d', 'b621e01d-9329-4776-b391-21c6aad2e772', '7824434e-e99b-437d-9595-62448dae89d7', 'fd28498f-2f99-42fc-8ed9-6d87fe42f839'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:10 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" returned: 0 in 0.921s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:10 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 1G Apr 30 11:01:10 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a2375056-7935-4569-bd0d-0405407294e7 tempest-GroupSnapshotsV319Test-1876097681 None] group_snapshot 2080ab81-408e-4b3d-b38f-9f85456502ff: deleted successfully Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:11 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 1G" returned: 0 in 0.866s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:11 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:11 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc6e26d-6c6d-4122-b318-df131aae60c5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:11 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 Apr 30 11:01:11 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:12 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:12 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.913s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:12 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 is being set with open permissions: ugo+rw Apr 30 11:01:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046" returned: 0 in 0.887s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:12 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:12 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:12 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046 Apr 30 11:01:12 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:13 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-efaaf4e2-f6b8-47e2-bce9-4df84af43046" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Lock "cinder-quobyte-efaaf4e2-f6b8-47e2-bce9-4df84af43046" released by "delete_volume" :: held 1.733s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:13 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.775s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:13 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info Apr 30 11:01:13 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Created reservations ['b356c1a6-4223-42ca-a741-c8f80db74f92'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:13 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1629540296 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1629540296, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Created reservations ['730d952f-9d49-45d1-bf3a-3b122809bbfd', 'aac89147-3dbe-4a6f-a1bd-fe43d3937582', '0ca3c783-4e2f-4ee5-961c-25988a8fb187', 'a5551225-1d77-4366-bdc1-0b8329eeea47'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:13 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:13 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:14 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info" returned: 0 in 1.065s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:14 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info is being set with open permissions: ugo+rw Apr 30 11:01:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:14 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info Apr 30 11:01:14 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:14 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.049s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:14 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:14 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a9e2603b-3e3c-448e-8ecf-73ebfe51305f tempest-GroupSnapshotsV319Test-1876097681 None] Delete group completed successfully. Apr 30 11:01:15 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.info" returned: 0 in 0.834s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.522s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-80fced35-f50f-40e9-ae99-382b23500c60 tempest-VolumesDeleteCascade-1587105418 None] Create snapshot completed successfully Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Creating offline snapshot 5c9fd1a6-be27-4d88-a775-af3fdaf6c452 of volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdbc58-fe45-4ab3-8c34-a1e62a6aa9a4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:16 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:16 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:16 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.794s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:16 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 1G Apr 30 11:01:16 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:17 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 1G" returned: 0 in 1.000s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:17 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 Apr 30 11:01:17 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:18 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452" returned: 0 in 0.872s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:18 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 is being set with open permissions: ugo+rw Apr 30 11:01:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:18 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 Apr 30 11:01:18 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:19 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452" returned: 0 in 0.775s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.589s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:19 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2ae807af-fdef-4cfe-bf51-6ec0efcc1cba tempest-VolumesDeleteCascade-1587105418 None] Create snapshot completed successfully Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Performing cascade delete. {{(pid=84432) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-5c9fd1a6-be27-4d88-a775-af3fdaf6c452-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-5c9fd1a6-be27-4d88-a775-af3fdaf6c452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-5c9fd1a6-be27-4d88-a775-af3fdaf6c452" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-5c9fd1a6-be27-4d88-a775-af3fdaf6c452" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Deleting offline snapshot 5c9fd1a6-be27-4d88-a775-af3fdaf6c452 of volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] snapshot_file for this snap is: volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05447cd-8353-4e93-aa15-67aa6bdb2e85]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:20 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 Apr 30 11:01:20 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:21 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[131502f4-aee5-4e15-bfce-fe1929c5883f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:21 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:21 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:22 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.874s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:22 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 Apr 30 11:01:22 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:23 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452" returned: 0 in 0.987s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:23 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452 Apr 30 11:01:23 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f08fc2ff-f9f4-4eb3-a117-592610015f61 tempest-GroupsTest-463297619 None] Group tempest-Group1-863300383: creating Apr 30 11:01:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f08fc2ff-f9f4-4eb3-a117-592610015f61 tempest-GroupsTest-463297619 None] Group tempest-Group1-863300383: created successfully Apr 30 11:01:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f08fc2ff-f9f4-4eb3-a117-592610015f61 tempest-GroupsTest-463297619 None] Create group completed successfully. Apr 30 11:01:23 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.5c9fd1a6-be27-4d88-a775-af3fdaf6c452" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-5c9fd1a6-be27-4d88-a775-af3fdaf6c452" released by "_delete_snapshot" :: held 3.458s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" released by "delete_snapshot" :: held 3.482s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['4fded295-e95b-478d-9787-efcdb647c8f6', '64b705ae-fb50-4c85-aecc-5ab5de21c5b5', 'f62e840a-23db-4fcd-8aa0-5ab55e1dd554', '65874f89-54a5-4f2e-b5f2-ba622330a091'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Delete snapshot completed successfully. Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-5c9fd1a6-be27-4d88-a775-af3fdaf6c452-delete_snapshot" released by "delete_snapshot" :: held 3.639s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-d1b68dc2-4900-4812-b9f5-6185bce2cde3-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-d1b68dc2-4900-4812-b9f5-6185bce2cde3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-d1b68dc2-4900-4812-b9f5-6185bce2cde3" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-d1b68dc2-4900-4812-b9f5-6185bce2cde3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Deleting offline snapshot d1b68dc2-4900-4812-b9f5-6185bce2cde3 of volume cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] snapshot_file for this snap is: volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b2f40-1dc4-4d97-af5b-a41b402389d0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:24 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:24 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d730cd3b-b448-4e6e-93aa-b927003da0b9 tempest-GroupsTest-463297619 None] Group tempest-Group2-350638125: creating Apr 30 11:01:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d730cd3b-b448-4e6e-93aa-b927003da0b9 tempest-GroupsTest-463297619 None] Group tempest-Group2-350638125: created successfully Apr 30 11:01:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d730cd3b-b448-4e6e-93aa-b927003da0b9 tempest-GroupsTest-463297619 None] Create group completed successfully. Apr 30 11:01:25 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.842s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec2e48-4d04-4723-8e69-f4f4569d8d86]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:25 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 Apr 30 11:01:25 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:25 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" returned: 0 in 0.741s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:25 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:25 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (303e5fe3-b19b-462a-bcdd-50af50f4c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e284ccd-ecd2-4662-baec-6d23e5c5f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e284ccd-ecd2-4662-baec-6d23e5c5f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1030726378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e02e2392-b482-4ffa-b620-6fb7fda039bb,host='devstack@QuobyteHD#QuobyteHD',id=fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:26Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06b5bb92-5076-4214-8743-46c618b84c2d),volume_type_id=06b5bb92-5076-4214-8743-46c618b84c2d)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41572d5d-1f46-4d08-a75c-c96b11e44438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41572d5d-1f46-4d08-a75c-c96b11e44438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183fa72-dc1f-41f1-90b2-f3a5a2f26049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183fa72-dc1f-41f1-90b2-f3a5a2f26049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8', 'volume_name': 'volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b21fa47-64ce-4432-8a3d-7dfa8d143115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b21fa47-64ce-4432-8a3d-7dfa8d143115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b58c992-baa1-4628-86b2-a838dbdd1546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:26 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Volume fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8', 'volume_size': 1} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e02e2392-b482-4ffa-b620-6fb7fda039bb,created_at=2026-04-30T09:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1030726378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e02e2392-b482-4ffa-b620-6fb7fda039bb,host='devstack@QuobyteHD#QuobyteHD',id=fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:26Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06b5bb92-5076-4214-8743-46c618b84c2d),volume_type_id=06b5bb92-5076-4214-8743-46c618b84c2d)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Creating volume fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:26 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:26 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 1073741824 Apr 30 11:01:26 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:26 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.804s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:26 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3 Apr 30 11:01:26 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:27 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0.d1b68dc2-4900-4812-b9f5-6185bce2cde3" returned: 0 in 0.648s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-d1b68dc2-4900-4812-b9f5-6185bce2cde3" released by "_delete_snapshot" :: held 3.162s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" released by "delete_snapshot" :: held 3.192s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['bfe18fce-b9b9-4f27-8832-ad463b3f333e', 'b832e108-2d6e-4863-ae7a-539b248549fb', '7a14cdb5-872c-4e8e-9d93-29b0c20584a6', '10202048-25bf-4b47-b34d-18cd58f54f81'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:27 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Delete snapshot completed successfully. Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 1073741824" returned: 0 in 1.052s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-d1b68dc2-4900-4812-b9f5-6185bce2cde3-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Snapshots deleted, issuing volume delete {{(pid=84432) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d6b49-b93f-496b-b2a1-283fb01590b6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:27 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 Apr 30 11:01:27 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:27 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 Apr 30 11:01:27 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:28 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" returned: 0 in 0.898s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b58c992-baa1-4628-86b2-a838dbdd1546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6665ff-4cc5-4223-8178-bb43ed831663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:28 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" returned: 0 in 0.964s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Volume volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 (fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8): created successfully Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6665ff-4cc5-4223-8178-bb43ed831663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (303e5fe3-b19b-462a-bcdd-50af50f4c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:28 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0 Apr 30 11:01:28 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-35086a0d-827c-4819-92cd-eb5e5606b62e tempest-GroupsTest-463297619 None] Created volume successfully. Apr 30 11:01:29 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" returned: 0 in 0.719s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0" released by "delete_volume" :: held 1.771s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['8d39910e-75c9-45d2-896f-a3eea9425cdd', 'c76e1754-83ce-42ed-a379-30d9157e9bbc', 'fadfdf70-827a-433f-84c7-eda41ad60e95', '63d54df1-b1aa-4ba0-82be-2fdb4e39ed44'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:29 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:29 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:30 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.691s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Deleted volume successfully. Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-773267b7-0de0-46a7-a68b-ae2c91c7c98a tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-cfcc6dd5-8caf-4beb-a9b2-01ff80e6c1a0-delete_volume" released by "delete_volume" :: held 9.946s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Acquiring lock "cinder-quobyte-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e7e21-e368-4e95-b2e3-031768959f99]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:30 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 Apr 30 11:01:30 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:30 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (cc9bfdb8-3026-4c79-acd1-0344cdeebfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9409d772-8cb2-4083-8ee4-494310fbf9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9409d772-8cb2-4083-8ee4-494310fbf9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1954390266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d117277-421c-4e0f-b941-9b060f6f2ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0dba9a3d744d5189f1f7aa7ca82417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:31Z,use_quota=True,user_id='fbe21476e67d48509a7b94298c571f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3ca9c-97c2-4a41-ae1f-a671235b434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d3ca9c-97c2-4a41-ae1f-a671235b434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d37cb3-5835-48fe-be19-9811b3dad158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d37cb3-5835-48fe-be19-9811b3dad158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d117277-421c-4e0f-b941-9b060f6f2ce3', 'volume_name': 'volume-3d117277-421c-4e0f-b941-9b060f6f2ce3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92332dce-119c-454f-81d8-45deb9f614dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92332dce-119c-454f-81d8-45deb9f614dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052fc474-25df-4a8b-af93-9b0d43a778ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Volume 3d117277-421c-4e0f-b941-9b060f6f2ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d117277-421c-4e0f-b941-9b060f6f2ce3', 'volume_size': 1} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1954390266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d117277-421c-4e0f-b941-9b060f6f2ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0dba9a3d744d5189f1f7aa7ca82417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:31Z,use_quota=True,user_id='fbe21476e67d48509a7b94298c571f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Creating volume 3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:31 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:31 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 1073741824 Apr 30 11:01:31 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:31 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" returned: 0 in 0.838s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:31 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8 Apr 30 11:01:31 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:32 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 1073741824" returned: 0 in 0.930s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:32 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:32 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:32 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-fdcd7eff-1d90-4d73-8f8d-db33ae47f0c8" released by "delete_volume" :: held 1.632s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Created reservations ['c8d76185-a9cf-4d8a-8c01-43cb4cddccb4'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:32 devstack cinder-volume[84432]: WARNING cinder.quota [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1551685105 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1551685105, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:01:32 devstack cinder-volume[84432]: WARNING cinder.quota [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1551685105 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1551685105, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Created reservations ['8e6383bc-4abd-4638-a685-7ce494f55e3c', '7324120e-d99b-453d-8627-b14c10cd8feb', '8db36aca-8106-4250-8080-215a28e9c25b', 'cca7cd85-ae89-42be-a038-b6ba741fca81'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:32 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:32 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:32 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052fc474-25df-4a8b-af93-9b0d43a778ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d117277-421c-4e0f-b941-9b060f6f2ce3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d51b0d1-bae9-428c-9f4c-9bd8f1a2fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Volume volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 (3d117277-421c-4e0f-b941-9b060f6f2ce3): created successfully Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d51b0d1-bae9-428c-9f4c-9bd8f1a2fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (cc9bfdb8-3026-4c79-acd1-0344cdeebfc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c9f19141-0eb2-4765-907b-9f9715b81721 tempest-VolumesDeleteCascade-1587105418 None] Created volume successfully. Apr 30 11:01:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Created reservations ['756d11a7-7117-4dda-8e47-c5dff6ffc94a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:33 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:33 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:33 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Flow 'volume_create_manager' (e8715c1b-aa1e-4839-bb47-8ba077c2ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f77261-3694-4651-b2ca-6c94e9d20944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.717s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-db21645f-e804-4950-86a1-c091920bc0dd tempest-GroupsTest-463297619 None] Delete group completed successfully. Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f77261-3694-4651-b2ca-6c94e9d20944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1313069316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdc2cac-2f50-4e85-a6b8-0b895dafa524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d36ef7603e14c2b9c71ed19b17a7070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:33Z,use_quota=True,user_id='6d56460d87dc466886b0fbe3875a999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffac6c1-015f-4285-8da5-92dac1e0ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffac6c1-015f-4285-8da5-92dac1e0ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9a836-dbea-4e08-be7a-de8c0468229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Creating offline snapshot e3156474-b13b-4b80-8b4a-479e9036968d of volume 3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d32384-0552-49ad-a984-0b1aa14d001c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:33 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:33 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9a836-dbea-4e08-be7a-de8c0468229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bdc2cac-2f50-4e85-a6b8-0b895dafa524', 'volume_name': 'volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd295273-3fae-4bf4-a09c-ef3306fee6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd295273-3fae-4bf4-a09c-ef3306fee6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411fb4dd-f23e-421a-aade-05dfc1533fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Trying to clone 8bdc2cac-2f50-4e85-a6b8-0b895dafa524 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:01:33 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.779s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fff411e8-8fa7-41dd-be0c-9442930b7844 tempest-GroupsTest-463297619 None] Delete group completed successfully. Apr 30 11:01:33 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:01:33 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[161af92b-3485-4ecc-acad-259277c0d5dd]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:34 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD Apr 30 11:01:34 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:34 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.849s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:34 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d 1G Apr 30 11:01:34 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c0b40bf4-ad6c-4a2f-85ef-9ce09be6c500 tempest-GroupsTest-463297619 None] Group tempest-GroupsTest-Group-226685248: creating Apr 30 11:01:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c0b40bf4-ad6c-4a2f-85ef-9ce09be6c500 tempest-GroupsTest-463297619 None] Group tempest-GroupsTest-Group-226685248: created successfully Apr 30 11:01:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c0b40bf4-ad6c-4a2f-85ef-9ce09be6c500 tempest-GroupsTest-463297619 None] Create group completed successfully. Apr 30 11:01:34 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 6d56460d87dc466886b0fbe3875a999a. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f724c6d8-cda4-461a-b4d1-d75c764391c0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:35 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD Apr 30 11:01:35 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:35 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d 1G" returned: 0 in 1.221s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:35 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:35 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:36 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD" returned: 0 in 1.092s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (c50f4daf-5cae-47e9-8031-b4b13bb46966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a1ebc-2765-43e0-a19b-d254fa84f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a1ebc-2765-43e0-a19b-d254fa84f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523988490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03502149-f407-480f-88af-1353ea58fbae,host='devstack@QuobyteHD#QuobyteHD',id=3b0b8049-530c-4140-a332-9d2601deb5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:37Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9084590a-87b7-473a-9e6e-ef78a90b278e),volume_type_id=9084590a-87b7-473a-9e6e-ef78a90b278e)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde13207-8cdb-431d-af64-925d037a9161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde13207-8cdb-431d-af64-925d037a9161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896d0cbc-70ad-4a9e-ab68-83a18e38400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896d0cbc-70ad-4a9e-ab68-83a18e38400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0b8049-530c-4140-a332-9d2601deb5f2', 'volume_name': 'volume-3b0b8049-530c-4140-a332-9d2601deb5f2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2874ca81-756b-4157-b99f-15e874dd6044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:36 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2874ca81-756b-4157-b99f-15e874dd6044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac0cab9-53ce-462b-b707-2d27243cf9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Volume 3b0b8049-530c-4140-a332-9d2601deb5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0b8049-530c-4140-a332-9d2601deb5f2', 'volume_size': 1} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 1.129s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:36 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d is being set with open permissions: ugo+rw Apr 30 11:01:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:36 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:36 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:37 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:37 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info Apr 30 11:01:37 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:38 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info" returned: 0 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:38 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info is being set with open permissions: ugo+rw Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:38 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info Apr 30 11:01:38 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:38 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.info" returned: 0 in 0.663s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.299s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.661s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1313069316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdc2cac-2f50-4e85-a6b8-0b895dafa524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d36ef7603e14c2b9c71ed19b17a7070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:33Z,use_quota=True,user_id='6d56460d87dc466886b0fbe3875a999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Creating volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:38 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:38 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1073741824 Apr 30 11:01:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-32dcb31a-d898-4933-90f0-37ea613bb0b4 tempest-VolumesDeleteCascade-1587105418 None] Create snapshot completed successfully Apr 30 11:01:38 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:39 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1073741824" returned: 0 in 0.919s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:39 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:39 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:40 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 0 in 0.731s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03502149-f407-480f-88af-1353ea58fbae,created_at=2026-04-30T09:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523988490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03502149-f407-480f-88af-1353ea58fbae,host='devstack@QuobyteHD#QuobyteHD',id=3b0b8049-530c-4140-a332-9d2601deb5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:37Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9084590a-87b7-473a-9e6e-ef78a90b278e),volume_type_id=9084590a-87b7-473a-9e6e-ef78a90b278e)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Creating volume 3b0b8049-530c-4140-a332-9d2601deb5f2 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:40 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:40 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 1073741824 Apr 30 11:01:40 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (e20c5033-381d-4219-9e73-6beedb447da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d97af08-81fe-46e2-8098-c2bc1463f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d97af08-81fe-46e2-8098-c2bc1463f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2057309124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191ffdc9-fa62-4134-9502-bcbf69153480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0dba9a3d744d5189f1f7aa7ca82417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3156474-b13b-4b80-8b4a-479e9036968d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:40Z,use_quota=True,user_id='fbe21476e67d48509a7b94298c571f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8dc0ea-d30d-4265-bc60-93fb532c6315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8dc0ea-d30d-4265-bc60-93fb532c6315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002e7e99-c92f-4e30-8050-aedd6218f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002e7e99-c92f-4e30-8050-aedd6218f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '191ffdc9-fa62-4134-9502-bcbf69153480', 'volume_name': 'volume-191ffdc9-fa62-4134-9502-bcbf69153480', 'volume_size': 1, 'snapshot_id': 'e3156474-b13b-4b80-8b4a-479e9036968d'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f094563-697b-47ea-a7eb-ca8108745edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f094563-697b-47ea-a7eb-ca8108745edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6de2e55-ce8a-4c14-a69c-468c89e5d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Volume 191ffdc9-fa62-4134-9502-bcbf69153480: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-191ffdc9-fa62-4134-9502-bcbf69153480', 'volume_size': 1, 'snapshot_id': 'e3156474-b13b-4b80-8b4a-479e9036968d'} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec725a0e-9308-4884-a81b-775d929b6069]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:40 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0 Apr 30 11:01:40 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:41 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 1073741824" returned: 0 in 0.995s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:41 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0" returned: 0 in 0.897s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:41 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 Apr 30 11:01:41 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:41 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0 Apr 30 11:01:41 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:42 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2" returned: 0 in 0.816s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.714s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d-191ffdc9-fa62-4134-9502-bcbf69153480" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:42 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0" returned: 1 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_gx0ymry0' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac0cab9-53ce-462b-b707-2d27243cf9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0b8049-530c-4140-a332-9d2601deb5f2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a7f71c-3556-42f0-9ef3-41a8cb0795e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2e89c-b44b-45b8-8b0f-78cc1793bd6b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d-191ffdc9-fa62-4134-9502-bcbf69153480" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Creating volume 191ffdc9-fa62-4134-9502-bcbf69153480 from snapshot e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Volume volume-3b0b8049-530c-4140-a332-9d2601deb5f2 (3b0b8049-530c-4140-a332-9d2601deb5f2): created successfully Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a7f71c-3556-42f0-9ef3-41a8cb0795e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (c50f4daf-5cae-47e9-8031-b4b13bb46966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] snapshot: e3156474-b13b-4b80-8b4a-479e9036968d, volume: 191ffdc9-fa62-4134-9502-bcbf69153480, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:01:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-baff72f9-9544-4f5d-b4e7-6a2caba3c4f6 tempest-GroupsTest-463297619 None] Created volume successfully. Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:42 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD Apr 30 11:01:42 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[296566c1-e954-4a6a-a567-9c73cb2c874a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:42 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:42 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:43 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:43 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:43 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:43 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 0.811s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d117277-421c-4e0f-b941-9b060f6f2ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c170c1-f247-49bf-ab1b-abaed21e0715]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:43 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:43 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (0fb65ea1-68cd-4c8a-b5e9-13a401f3a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5606d306-4c02-4cb8-a8a0-57c4724a5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5606d306-4c02-4cb8-a8a0-57c4724a5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286317643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03502149-f407-480f-88af-1353ea58fbae,host='devstack@QuobyteHD#QuobyteHD',id=d132eca9-78e0-4f1e-9254-3fff9d0bf154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:44Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9084590a-87b7-473a-9e6e-ef78a90b278e),volume_type_id=9084590a-87b7-473a-9e6e-ef78a90b278e)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342e825b-2c08-46d1-997f-a2df1581e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342e825b-2c08-46d1-997f-a2df1581e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d3d05d-d67e-496a-8039-0791ce8970f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d3d05d-d67e-496a-8039-0791ce8970f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd132eca9-78e0-4f1e-9254-3fff9d0bf154', 'volume_name': 'volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a77cfad-51d6-4eaa-ad46-4a7d6b1a236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a77cfad-51d6-4eaa-ad46-4a7d6b1a236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dad1576-8b5b-408d-ab8f-fa9defe1b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Volume d132eca9-78e0-4f1e-9254-3fff9d0bf154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154', 'volume_size': 1} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:44 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 1.436s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:01:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:44 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 Apr 30 11:01:44 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:45 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 0 in 2.369s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:45 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1iv91zi9devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:01:45 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Converted 112.00 MB image at 47.25 MB/s Apr 30 11:01:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:45 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1G Apr 30 11:01:45 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:47 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 1G" returned: 0 in 1.611s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:47 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d53142-635a-4c49-830f-0a60d75c648d]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:47 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:47 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:49 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 0 in 2.149s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:49 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:49 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:50 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 1 in 1.476s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 6d56460d87dc466886b0fbe3875a999a is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Marking volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=102,cinder:INSERT=23,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to 8bdc2cac-2f50-4e85-a6b8-0b895dafa524. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Creating volume glance metadata for volume 8bdc2cac-2f50-4e85-a6b8-0b895dafa524 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:01:50 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=102,cinder:SELECT=96,cinder:INSERT=27,cinder:DELETE=5 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411fb4dd-f23e-421a-aade-05dfc1533fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08c506e-e24a-4447-9959-faec9e8fc651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Volume volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 (8bdc2cac-2f50-4e85-a6b8-0b895dafa524): created successfully Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08c506e-e24a-4447-9959-faec9e8fc651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Flow 'volume_create_manager' (e8715c1b-aa1e-4839-bb47-8ba077c2ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:51 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480" returned: 0 in 6.245s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-df050cfa-d1fe-47c9-ab4b-8252a2b46a7a tempest-VolumesImageMetadata-1115334280 None] Created volume successfully. Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3bbd97-035b-473e-919f-eb54e68da442]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:51 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:51 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:51 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.835s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:01:51 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Converted 1024.00 MB image at 163.95 MB/s Apr 30 11:01:51 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 is being set with open permissions: ugo+rw Apr 30 11:01:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:51 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 Apr 30 11:01:51 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:52 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" released by "_copy_volume_from_snapshot" :: held 10.059s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d-191ffdc9-fa62-4134-9502-bcbf69153480" released by "_create_volume_from_snapshot" :: held 10.108s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.169s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.883s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03502149-f407-480f-88af-1353ea58fbae,created_at=2026-04-30T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286317643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03502149-f407-480f-88af-1353ea58fbae,host='devstack@QuobyteHD#QuobyteHD',id=d132eca9-78e0-4f1e-9254-3fff9d0bf154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279e0aa1220943dabb39670cf424a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:01:44Z,use_quota=True,user_id='47b990dc13e5482fba61d831ba88ffe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9084590a-87b7-473a-9e6e-ef78a90b278e),volume_type_id=9084590a-87b7-473a-9e6e-ef78a90b278e)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Creating volume d132eca9-78e0-4f1e-9254-3fff9d0bf154 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:01:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Acquiring lock "cinder-8bdc2cac-2f50-4e85-a6b8-0b895dafa524-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:52 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 1073741824 Apr 30 11:01:52 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "cinder-8bdc2cac-2f50-4e85-a6b8-0b895dafa524-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6de2e55-ce8a-4c14-a69c-468c89e5d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191ffdc9-fa62-4134-9502-bcbf69153480', 'volume_size': 1, 'snapshot_id': 'e3156474-b13b-4b80-8b4a-479e9036968d'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5fa19d-729b-4b1c-8cd0-fffb22b2eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Volume volume-191ffdc9-fa62-4134-9502-bcbf69153480 (191ffdc9-fa62-4134-9502-bcbf69153480): created successfully Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5fa19d-729b-4b1c-8cd0-fffb22b2eb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Flow 'volume_create_manager' (e20c5033-381d-4219-9e73-6beedb447da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Acquiring lock "cinder-quobyte-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-49aa9e21-9dcf-4ba1-a9fd-34b8a5e2e7b0 tempest-VolumesDeleteCascade-1587105418 None] Created volume successfully. Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "cinder-quobyte-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c15b34e-9f41-40f1-a61f-5e0c8dc6f296]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:52 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:52 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-3d117277-421c-4e0f-b941-9b060f6f2ce3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-3d117277-421c-4e0f-b941-9b060f6f2ce3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Performing cascade delete. {{(pid=84432) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-e3156474-b13b-4b80-8b4a-479e9036968d-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-e3156474-b13b-4b80-8b4a-479e9036968d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Deleting offline snapshot e3156474-b13b-4b80-8b4a-479e9036968d of volume 3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] snapshot_file for this snap is: volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471b448-1676-4068-ae92-f4f4e2c41d05]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:53 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:53 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:53 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 1073741824" returned: 0 in 0.880s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:53 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:53 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 0 in 0.763s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:53 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:53 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:53 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:53 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d117277-421c-4e0f-b941-9b060f6f2ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d567479-931c-4175-af28-e0f9eb78db07]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:54 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:54 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:54 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154" returned: 0 in 0.583s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dad1576-8b5b-408d-ab8f-fa9defe1b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b7d575-ffd7-49b3-8595-54f0e7fc50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:01:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Volume volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 (d132eca9-78e0-4f1e-9254-3fff9d0bf154): created successfully Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b7d575-ffd7-49b3-8595-54f0e7fc50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Flow 'volume_create_manager' (0fb65ea1-68cd-4c8a-b5e9-13a401f3a56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:01:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-92c50ae9-ffc8-49d1-afd8-c84e07978710 tempest-GroupsTest-463297619 None] Created volume successfully. Apr 30 11:01:54 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 1 in 0.711s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:54 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524 Apr 30 11:01:54 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:54 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:54 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:54 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:54 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" returned: 0 in 0.615s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "cinder-quobyte-8bdc2cac-2f50-4e85-a6b8-0b895dafa524" released by "delete_volume" :: held 2.162s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Created reservations ['c8d58234-83c3-4a0c-9b72-5b5399b0f353', '5a06b39e-7e88-4e9f-9af3-3afc2613baee', 'e3aa29b6-d669-488e-bce2-a8ef2e3d9630', '932e6972-8a5b-45dd-ac3f-b6d365375585'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:55 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:55 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-05637ee4-a5a8-43e0-a2e8-a54af85ad803 tempest-GroupsTest-463297619 None] Update group completed successfully. Apr 30 11:01:55 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:55 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d Apr 30 11:01:55 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:55 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Deleted volume successfully. Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-80d601c7-90ff-460b-ba22-a0e9b27cb0b6 tempest-VolumesImageMetadata-1115334280 None] Lock "cinder-8bdc2cac-2f50-4e85-a6b8-0b895dafa524-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:55 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3.e3156474-b13b-4b80-8b4a-479e9036968d" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-e3156474-b13b-4b80-8b4a-479e9036968d" released by "_delete_snapshot" :: held 2.831s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" released by "delete_snapshot" :: held 2.854s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['98bc2ab1-9541-4895-b3ff-2ec4dadc7132', '959ac66b-5e2e-479a-bcf5-61aa0e764fbd', '99bc1243-0ee5-4115-aebf-dd66a78be034', '4f08c017-cab1-48ce-84a0-86d9fac0badc'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Delete snapshot completed successfully. Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-e3156474-b13b-4b80-8b4a-479e9036968d-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Snapshots deleted, issuing volume delete {{(pid=84432) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f898f444-31ac-4380-82a2-bdc22df256c7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:56 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:56 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4f9284f3-1631-40d6-912c-11689c1b5b80 tempest-GroupsTest-463297619 None] Update group completed successfully. Apr 30 11:01:57 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.910s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:57 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3 Apr 30 11:01:57 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:57 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3d117277-421c-4e0f-b941-9b060f6f2ce3" returned: 0 in 0.803s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-3d117277-421c-4e0f-b941-9b060f6f2ce3" released by "delete_volume" :: held 1.822s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Acquiring lock "cinder-quobyte-3b0b8049-530c-4140-a332-9d2601deb5f2" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-3b0b8049-530c-4140-a332-9d2601deb5f2" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f037a78-7d3f-4898-9b3c-e77ad019f706]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['04ded578-d1ad-4cd5-aa51-befe58e87dd2', '75a34818-1025-4a33-bf8d-abd318a3be6d', '312d43cb-e0c7-40ac-a1cc-c2b4e08e9436', '0508510f-224b-47ab-88c2-b435b8c1f215'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:58 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 Apr 30 11:01:58 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:58 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:01:58 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-191ffdc9-fa62-4134-9502-bcbf69153480-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-191ffdc9-fa62-4134-9502-bcbf69153480-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62b105-aa82-414b-965c-2579b2318450]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:59 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2" returned: 0 in 0.986s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:59 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:59 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2 Apr 30 11:01:59 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.906s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:01:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Deleted volume successfully. Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ed5228e8-80f4-4ddb-beee-19d71317f5ac tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-3d117277-421c-4e0f-b941-9b060f6f2ce3-delete_volume" released by "delete_volume" :: held 6.071s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:59 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 Apr 30 11:01:59 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:59 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3b0b8049-530c-4140-a332-9d2601deb5f2" returned: 0 in 0.711s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-3b0b8049-530c-4140-a332-9d2601deb5f2" released by "delete_volume" :: held 1.754s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Acquiring lock "cinder-quobyte-d132eca9-78e0-4f1e-9254-3fff9d0bf154" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:01:59 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-d132eca9-78e0-4f1e-9254-3fff9d0bf154" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:01:59 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480 Apr 30 11:01:59 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed99b2a-9b35-450f-8030-5579b5af0357]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:01:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:59 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 Apr 30 11:01:59 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:00 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-191ffdc9-fa62-4134-9502-bcbf69153480" returned: 0 in 0.678s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-quobyte-191ffdc9-fa62-4134-9502-bcbf69153480" released by "delete_volume" :: held 1.510s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Created reservations ['ec644aae-400e-4b55-9b42-38c5c0471fb1', 'b1f2a2b1-125a-4285-8181-b00b7f78bd6f', '0daaf9cf-188d-4ad5-b628-479079aa2946', '9924df2d-3941-4c33-92af-cf2e452e6c28'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:00 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154" returned: 0 in 0.843s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:00 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:00 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:00 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154 Apr 30 11:02:00 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Flow 'volume_create_manager' (5cb14ee3-5d05-4724-9421-701a3962050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bf6306-4c14-4537-9212-73a24b6c6c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bf6306-4c14-4537-9212-73a24b6c6c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1385804819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6f7349-a7c7-456e-8c56-2e0604add305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c501577182a04b4eb10f7eea165905c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:01Z,use_quota=True,user_id='45ecebfc6eec4fd59cbe7f045d10933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e74a855-7a12-43c4-b3eb-97e16b813ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e74a855-7a12-43c4-b3eb-97e16b813ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57863ad4-e428-457c-bafa-498d4c34fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57863ad4-e428-457c-bafa-498d4c34fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6f7349-a7c7-456e-8c56-2e0604add305', 'volume_name': 'volume-0f6f7349-a7c7-456e-8c56-2e0604add305', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5cc36-779b-4bb3-9f4d-7a9aa831a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5cc36-779b-4bb3-9f4d-7a9aa831a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca3e38-7f26-4dad-af27-37a1014fc3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:00 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume 0f6f7349-a7c7-456e-8c56-2e0604add305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6f7349-a7c7-456e-8c56-2e0604add305', 'volume_size': 1} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1385804819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6f7349-a7c7-456e-8c56-2e0604add305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c501577182a04b4eb10f7eea165905c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:01Z,use_quota=True,user_id='45ecebfc6eec4fd59cbe7f045d10933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Creating volume 0f6f7349-a7c7-456e-8c56-2e0604add305 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:00 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:00 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 1073741824 Apr 30 11:02:00 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Flow 'volume_create_manager' (5088f3b9-d409-47ee-8ed0-e6b4133fc727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35974359-1f63-4300-9a98-06a856a94ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35974359-1f63-4300-9a98-06a856a94ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988465405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51876463-452e-45d6-964b-5eea9f348bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9721bd2c3471389c9939fb0134fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:01Z,use_quota=True,user_id='ad3ba49c60be43b598fdcaa31c2e1b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f606ae71-9987-41ed-a070-5c60ae565cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f606ae71-9987-41ed-a070-5c60ae565cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02e020-a70b-4483-ad04-010eb9ce8b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b02e020-a70b-4483-ad04-010eb9ce8b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51876463-452e-45d6-964b-5eea9f348bef', 'volume_name': 'volume-51876463-452e-45d6-964b-5eea9f348bef', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c2ece-f279-4945-9eec-fd202a3a03ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c2ece-f279-4945-9eec-fd202a3a03ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20656f29-4ecc-41f3-8edd-0804d8c1092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:01 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Volume 51876463-452e-45d6-964b-5eea9f348bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51876463-452e-45d6-964b-5eea9f348bef', 'volume_size': 1} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:01 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d132eca9-78e0-4f1e-9254-3fff9d0bf154" returned: 0 in 0.850s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "cinder-quobyte-d132eca9-78e0-4f1e-9254-3fff9d0bf154" released by "delete_volume" :: held 1.752s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:01 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.897s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Deleted volume successfully. Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aad028d-27ac-4aea-9afa-01457c4d0cfa tempest-VolumesDeleteCascade-1587105418 None] Lock "cinder-191ffdc9-fa62-4134-9502-bcbf69153480-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Created reservations ['411d5c6e-7cf9-4143-af16-6d38aaa92ee0'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:01 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-63980382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-63980382, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:02:01 devstack cinder-volume[84432]: WARNING cinder.quota [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-63980382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-63980382, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Created reservations ['748c49c5-b592-4165-a9c0-c1832a8d9b8b', 'a683d431-64e7-4b74-ab4e-dbf7db5203cf', 'f4329b5a-b4a0-45f3-acd0-6f20584c3494', '3258a99c-0166-497b-9201-08bd72bc66ac'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Created reservations ['424b94bb-9c52-43f6-acba-6f1919279a39', '7597d944-c770-4205-8518-859276aca52a', '02cebb43-c469-413f-bfe8-9fcdedcfe401', 'f74d2488-72d5-4e79-b15f-7c054f55e5f1'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:01 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:01 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:02 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 1073741824" returned: 0 in 1.090s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:02 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 Apr 30 11:02:02 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:02 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.696s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a8ab2615-e12e-450d-8a97-7a4b12773249 tempest-GroupsTest-463297619 None] Delete group completed successfully. Apr 30 11:02:02 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305" returned: 0 in 0.678s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.271s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988465405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51876463-452e-45d6-964b-5eea9f348bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9721bd2c3471389c9939fb0134fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:01Z,use_quota=True,user_id='ad3ba49c60be43b598fdcaa31c2e1b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Creating volume 51876463-452e-45d6-964b-5eea9f348bef {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:02 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca3e38-7f26-4dad-af27-37a1014fc3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6f7349-a7c7-456e-8c56-2e0604add305', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dee3f95-a673-4772-9020-c4df108c1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:02 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef 1073741824 Apr 30 11:02:02 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume volume-0f6f7349-a7c7-456e-8c56-2e0604add305 (0f6f7349-a7c7-456e-8c56-2e0604add305): created successfully Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dee3f95-a673-4772-9020-c4df108c1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Flow 'volume_create_manager' (5cb14ee3-5d05-4724-9421-701a3962050b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-76ce18ad-9bc3-48fc-b2f1-0b7954f5c648 tempest-AttachVolumeShelveTestJSON-1896847819 None] Created volume successfully. Apr 30 11:02:03 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef 1073741824" returned: 0 in 1.063s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:03 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef Apr 30 11:02:03 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:04 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20656f29-4ecc-41f3-8edd-0804d8c1092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51876463-452e-45d6-964b-5eea9f348bef', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5728ad-3e4e-4b24-984d-6f0a5cf51f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Volume volume-51876463-452e-45d6-964b-5eea9f348bef (51876463-452e-45d6-964b-5eea9f348bef): created successfully Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5728ad-3e4e-4b24-984d-6f0a5cf51f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Flow 'volume_create_manager' (5088f3b9-d409-47ee-8ed0-e6b4133fc727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-44faa1a2-aa09-4dff-afe3-0e2f0e7a66ed tempest-VolumesTransfersTest-1452444790 None] Created volume successfully. Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Flow 'volume_create_manager' (c4452a07-df0d-48cb-ab22-9445e996bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9c6892-1f83-4ec4-a759-07b422fa39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9c6892-1f83-4ec4-a759-07b422fa39a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1851436927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b685fd32-03d9-4c1d-be50-938b179a1c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21c5a6177b4bb68d87894c92c47d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:05Z,use_quota=True,user_id='f84bf16feb744e01b6c530f9bfa81e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779b2a37-f4bb-4dc9-b632-7ea21591af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779b2a37-f4bb-4dc9-b632-7ea21591af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b476b2-b7a4-4e67-9f4b-cf9971ff7e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b476b2-b7a4-4e67-9f4b-cf9971ff7e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b685fd32-03d9-4c1d-be50-938b179a1c7d', 'volume_name': 'volume-b685fd32-03d9-4c1d-be50-938b179a1c7d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4782dd-444d-4a09-9ce2-2a2bd59b50ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4782dd-444d-4a09-9ce2-2a2bd59b50ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97768a74-37b4-49c2-a8a7-f9d21e5da121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Volume b685fd32-03d9-4c1d-be50-938b179a1c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b685fd32-03d9-4c1d-be50-938b179a1c7d', 'volume_size': 1} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1851436927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b685fd32-03d9-4c1d-be50-938b179a1c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21c5a6177b4bb68d87894c92c47d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:05Z,use_quota=True,user_id='f84bf16feb744e01b6c530f9bfa81e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Creating volume b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:04 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:04 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d 1073741824 Apr 30 11:02:04 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:05 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d 1073741824" returned: 0 in 1.022s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:06 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:06 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:06 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:06 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7f62c1e3-0ce4-46e2-b4bd-7ce25ca4d803 tempest-VolumesTransfersTest-1491844299 None] Transfer volume completed successfully. Apr 30 11:02:06 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.708s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97768a74-37b4-49c2-a8a7-f9d21e5da121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b685fd32-03d9-4c1d-be50-938b179a1c7d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f4d010-2133-42e9-9f0e-7348d723961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:06 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Volume volume-b685fd32-03d9-4c1d-be50-938b179a1c7d (b685fd32-03d9-4c1d-be50-938b179a1c7d): created successfully Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f4d010-2133-42e9-9f0e-7348d723961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Flow 'volume_create_manager' (c4452a07-df0d-48cb-ab22-9445e996bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:06 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.717s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3ef19a04-ea35-4b77-9228-46bb57771829 tempest-VolumesCloneTest-72348006 None] Created volume successfully. Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Flow 'volume_create_manager' (371c7833-5204-4635-ba3c-30983c2ba503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0626b750-628c-475e-a860-b7edd54295dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0626b750-628c-475e-a860-b7edd54295dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1156903633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd17f45f-a7d1-4066-9fa6-5c3d186f1736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21c5a6177b4bb68d87894c92c47d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b685fd32-03d9-4c1d-be50-938b179a1c7d,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:08Z,use_quota=True,user_id='f84bf16feb744e01b6c530f9bfa81e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8e6548-670c-449d-b46f-86e578e31ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8e6548-670c-449d-b46f-86e578e31ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a02655-8463-4d94-af98-9994af7fe122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a02655-8463-4d94-af98-9994af7fe122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fd17f45f-a7d1-4066-9fa6-5c3d186f1736', 'volume_name': 'volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736', 'volume_size': 2, 'source_volid': 'b685fd32-03d9-4c1d-be50-938b179a1c7d', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde747de-469f-4f7e-9070-916956914179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde747de-469f-4f7e-9070-916956914179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d895ac-5b7e-4f36-b76d-95e92ea2fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Volume fd17f45f-a7d1-4066-9fa6-5c3d186f1736: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736', 'volume_size': 2, 'source_volid': 'b685fd32-03d9-4c1d-be50-938b179a1c7d', 'source_volstatus': 'available'} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:07 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Cloning volume b685fd32-03d9-4c1d-be50-938b179a1c7d to volume fd17f45f-a7d1-4066-9fa6-5c3d186f1736 Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "cinder-51876463-452e-45d6-964b-5eea9f348bef-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Creating offline snapshot c332de85-0fe2-4ae1-a061-a7fc39d03835 of volume b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-51876463-452e-45d6-964b-5eea9f348bef-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ebc288-aa3c-49af-8817-980af9fdd749]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "cinder-quobyte-51876463-452e-45d6-964b-5eea9f348bef" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-quobyte-51876463-452e-45d6-964b-5eea9f348bef" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2380c54e-3d28-4b86-8cf9-d1488d6c0f08]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:08 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:08 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:08 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef Apr 30 11:02:08 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:08 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.855s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:08 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 1G Apr 30 11:02:08 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:08 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef" returned: 0 in 0.791s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:08 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef Apr 30 11:02:08 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:09 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-51876463-452e-45d6-964b-5eea9f348bef" returned: 0 in 0.675s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-quobyte-51876463-452e-45d6-964b-5eea9f348bef" released by "delete_volume" :: held 1.519s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Created reservations ['b14f1857-91b7-4172-8f6d-ef5f55802653', '111e6fce-ca91-4956-b117-e230e754545f', '3b445920-cf03-4d64-a35f-40d32dc3d6f9', '4d61923a-f9eb-4483-a9c8-b7c1493834b9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:09 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 1G" returned: 0 in 0.968s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b685fd32-03d9-4c1d-be50-938b179a1c7d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:09 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:09 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:09 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b685fd32-03d9-4c1d-be50-938b179a1c7d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:09 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:10 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Flow 'volume_create_manager' (cb6b85a9-7ef5-4270-be26-703f963b1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4ccc09-4f61-44e4-ae9d-27fb6ebb42e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.852s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:10 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b685fd32-03d9-4c1d-be50-938b179a1c7d -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.854s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:10 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 is being set with open permissions: ugo+rw Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4ccc09-4f61-44e4-ae9d-27fb6ebb42e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469513632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f907c8d8e746e1bdd1fe3a53d635b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:11Z,use_quota=True,user_id='614084ca5aa64165bcd99aad786d5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b827ad5-b1b7-4a08-a33c-01782e3860d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b827ad5-b1b7-4a08-a33c-01782e3860d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:10 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0254bc-5aa1-41f4-8fb5-0a7c934da771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0254bc-5aa1-41f4-8fb5-0a7c934da771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf', 'volume_name': 'volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524657a8-8cba-451d-be10-627ef78c3c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524657a8-8cba-451d-be10-627ef78c3c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26dbc8c-87fb-4cdf-9bdb-2cfd455bbccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf', 'volume_size': 1} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Deleted volume successfully. Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-644ba4b9-6cd2-4efa-bd7a-95c0861da832 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-51876463-452e-45d6-964b-5eea9f348bef-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Flow 'volume_create_manager' (283b1b66-50c8-4efd-999f-8721cfb8ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c63917e-96bb-4cf0-afe7-f20799035606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c63917e-96bb-4cf0-afe7-f20799035606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1337094060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a92f812-7ea8-4193-8052-14da2c33e88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9721bd2c3471389c9939fb0134fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:11Z,use_quota=True,user_id='ad3ba49c60be43b598fdcaa31c2e1b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ec1ee-b9e8-4fac-8d93-8a1edcfe6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37ec1ee-b9e8-4fac-8d93-8a1edcfe6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbf1598-74f1-4be0-a620-6af458e3e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbf1598-74f1-4be0-a620-6af458e3e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a92f812-7ea8-4193-8052-14da2c33e88c', 'volume_name': 'volume-3a92f812-7ea8-4193-8052-14da2c33e88c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59352555-d183-4e6c-811d-3afa8cc5f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59352555-d183-4e6c-811d-3afa8cc5f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030e3f79-b2c2-49c3-a28e-9a2f057858a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Volume 3a92f812-7ea8-4193-8052-14da2c33e88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a92f812-7ea8-4193-8052-14da2c33e88c', 'volume_size': 1} Apr 30 11:02:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:11 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.673s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:11 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info Apr 30 11:02:11 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:11 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info" returned: 0 in 0.571s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:11 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info is being set with open permissions: ugo+rw Apr 30 11:02:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:12 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info Apr 30 11:02:12 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:12 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.info" returned: 0 in 0.577s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] snapshot: c332de85-0fe2-4ae1-a061-a7fc39d03835, volume: fd17f45f-a7d1-4066-9fa6-5c3d186f1736, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280c2e1-4856-4e60-ba5d-102385dc3394]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:12 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:12 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:13 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.769s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b685fd32-03d9-4c1d-be50-938b179a1c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[620cb78e-ffea-452d-8d47-d183db027884]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:13 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:13 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:14 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.685s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:14 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:02:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:14 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 Apr 30 11:02:14 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:19 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" returned: 0 in 5.387s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[51650e23-e012-4039-bcc2-343feaf393ba]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:19 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:19 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:20 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.920s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:20 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:02:20 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Converted 1024.00 MB image at 190.05 MB/s Apr 30 11:02:20 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 is being set with open permissions: ugo+rw Apr 30 11:02:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:20 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 Apr 30 11:02:20 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:21 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" returned: 0 in 0.662s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" released by "_copy_volume_from_snapshot" :: held 8.515s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-quobyte-c332de85-0fe2-4ae1-a061-a7fc39d03835" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-c332de85-0fe2-4ae1-a061-a7fc39d03835" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Deleting offline snapshot c332de85-0fe2-4ae1-a061-a7fc39d03835 of volume b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] snapshot_file for this snap is: volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[595329e1-725d-4aa0-8eb2-42adc34858bb]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:21 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:21 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=67,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:02:21 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b685fd32-03d9-4c1d-be50-938b179a1c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7c63fc-c630-4264-bd27-4cb5d2d5efed]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:22 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:22 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:22 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:22 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:22 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:23 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:23 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835 Apr 30 11:02:23 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:23 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d.c332de85-0fe2-4ae1-a061-a7fc39d03835" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-c332de85-0fe2-4ae1-a061-a7fc39d03835" released by "_delete_snapshot" :: held 2.851s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.130s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.263s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469513632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f907c8d8e746e1bdd1fe3a53d635b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:11Z,use_quota=True,user_id='614084ca5aa64165bcd99aad786d5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Creating volume e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:24 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:24 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf 1073741824 Apr 30 11:02:24 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d895ac-5b7e-4f36-b76d-95e92ea2fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736', 'volume_size': 2, 'source_volid': 'b685fd32-03d9-4c1d-be50-938b179a1c7d', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334f4813-c51d-4491-bc10-d8e91290aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:24 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Volume volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 (fd17f45f-a7d1-4066-9fa6-5c3d186f1736): created successfully Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334f4813-c51d-4491-bc10-d8e91290aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Flow 'volume_create_manager' (371c7833-5204-4635-ba3c-30983c2ba503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-77280095-b23f-4038-b07a-a940e1274d6b tempest-VolumesCloneTest-72348006 None] Created volume successfully. Apr 30 11:02:24 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf 1073741824" returned: 0 in 0.834s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:24 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf Apr 30 11:02:24 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-fd17f45f-a7d1-4066-9fa6-5c3d186f1736-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "cinder-fd17f45f-a7d1-4066-9fa6-5c3d186f1736-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdb12e0-11d7-4efb-baf7-ae13d488ee08]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:25 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 Apr 30 11:02:25 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:25 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" returned: 0 in 0.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.544s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1337094060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a92f812-7ea8-4193-8052-14da2c33e88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b9721bd2c3471389c9939fb0134fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:11Z,use_quota=True,user_id='ad3ba49c60be43b598fdcaa31c2e1b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Creating volume 3a92f812-7ea8-4193-8052-14da2c33e88c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:25 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:25 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c 1073741824 Apr 30 11:02:25 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26dbc8c-87fb-4cdf-9bdb-2cfd455bbccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf5849-5ce6-494a-8961-f947a7bf1eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:25 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf (e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf): created successfully Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf5849-5ce6-494a-8961-f947a7bf1eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Flow 'volume_create_manager' (cb6b85a9-7ef5-4270-be26-703f963b1b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6ca55c8b-41d7-4264-87b9-176117eecc65 tempest-VolumeQuotasAdminTestJSON-786818172 None] Created volume successfully. Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "cinder-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "cinder-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "cinder-quobyte-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "cinder-quobyte-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d6dd62-af35-41f1-bc26-857d15c99615]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:26 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf Apr 30 11:02:26 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:26 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" returned: 0 in 0.882s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:26 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736 Apr 30 11:02:26 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:26 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c 1073741824" returned: 0 in 0.839s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:26 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c Apr 30 11:02:26 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:26 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" returned: 0 in 0.796s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:26 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf Apr 30 11:02:26 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:26 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-fd17f45f-a7d1-4066-9fa6-5c3d186f1736" released by "delete_volume" :: held 1.570s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:26 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Created reservations ['3cfaafe7-3ddb-4e05-926e-f778b4af8d89', '3137bb38-378b-46cf-8045-e21bdee5c440', 'f7dadfa3-8bca-4f94-898c-7c34558dd75b', '5c03c4fc-9238-4331-8f65-6434da18de00'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:27 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c" returned: 0 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.043s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:27 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:27 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030e3f79-b2c2-49c3-a28e-9a2f057858a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a92f812-7ea8-4193-8052-14da2c33e88c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37915490-9ac7-4877-8e6a-492f8c986990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71d8b4-ead6-4959-b2a8-889408dd006b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:27 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Volume volume-3a92f812-7ea8-4193-8052-14da2c33e88c (3a92f812-7ea8-4193-8052-14da2c33e88c): created successfully Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37915490-9ac7-4877-8e6a-492f8c986990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Flow 'volume_create_manager' (283b1b66-50c8-4efd-999f-8721cfb8ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1ffaaf7b-c44f-4cdf-b768-6ab2358082d5 tempest-VolumesTransfersTest-1452444790 None] Created volume successfully. Apr 30 11:02:27 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 Apr 30 11:02:27 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:27 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" returned: 0 in 0.674s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "cinder-quobyte-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf" released by "delete_volume" :: held 1.531s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Created reservations ['5b648352-057a-4e0c-8a39-114ccaac3811', '0181ac71-f70f-4709-81e8-63ef4e0f058a', 'd6c1dd55-2beb-4483-9924-962c3d1ebfa9', '606bed17-11f9-4b3a-9ef6-fdd547a4a89e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-b685fd32-03d9-4c1d-be50-938b179a1c7d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "cinder-b685fd32-03d9-4c1d-be50-938b179a1c7d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Acquiring lock "cinder-quobyte-b685fd32-03d9-4c1d-be50-938b179a1c7d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:27 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:27 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-b685fd32-03d9-4c1d-be50-938b179a1c7d" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e2abfe-db10-46db-a686-a81161e671a5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:27 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.818s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Deleted volume successfully. Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0042e1ca-8944-40d8-b987-d5d10e035ff7 tempest-VolumesCloneTest-72348006 None] Lock "cinder-fd17f45f-a7d1-4066-9fa6-5c3d186f1736-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:27 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:27 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:27 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305" returned: 0 in 0.872s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.912s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-0f6f7349-a7c7-456e-8c56-2e0604add305', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '517e4e6b-e9ec-4e12-a0e2-e862b9a061b3', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:02:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-f4dbb88c-9544-4a00-ad18-05fa88172d3e req-805f85f4-b401-420c-a2c0-73dba6817fea tempest-AttachVolumeShelveTestJSON-1896847819 None] attachment_update completed successfully. Apr 30 11:02:28 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.712s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Deleted volume successfully. Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-eda8f31b-ee41-4aa3-9431-b71857faf1ce tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "cinder-e5bc9ff7-5b01-4c00-b4f8-3d78a76d1ccf-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:28 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Flow 'volume_create_manager' (fe4424f4-9af2-4fbd-9073-53fd6bea875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef42f3-d32b-4d74-9fe2-566cbd6af804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.945s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef42f3-d32b-4d74-9fe2-566cbd6af804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-674965016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230dceb6-9d42-4108-b2df-b8477cdb97d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f907c8d8e746e1bdd1fe3a53d635b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:29Z,use_quota=True,user_id='614084ca5aa64165bcd99aad786d5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e174dd22-0d05-4696-a457-edc34db4cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e174dd22-0d05-4696-a457-edc34db4cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cde0cd1-abec-4bbb-b371-b081fe8cf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:28 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d Apr 30 11:02:28 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cde0cd1-abec-4bbb-b371-b081fe8cf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230dceb6-9d42-4108-b2df-b8477cdb97d8', 'volume_name': 'volume-230dceb6-9d42-4108-b2df-b8477cdb97d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b327145-b769-4bee-92c1-81d1c3ec70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b327145-b769-4bee-92c1-81d1c3ec70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a56533-f55c-4eb4-8fda-677e9d3fb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume 230dceb6-9d42-4108-b2df-b8477cdb97d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230dceb6-9d42-4108-b2df-b8477cdb97d8', 'volume_size': 1} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-674965016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230dceb6-9d42-4108-b2df-b8477cdb97d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f907c8d8e746e1bdd1fe3a53d635b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:29Z,use_quota=True,user_id='614084ca5aa64165bcd99aad786d5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Creating volume 230dceb6-9d42-4108-b2df-b8477cdb97d8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:28 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:28 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 1073741824 Apr 30 11:02:28 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "cinder-3a92f812-7ea8-4193-8052-14da2c33e88c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-3a92f812-7ea8-4193-8052-14da2c33e88c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "cinder-quobyte-3a92f812-7ea8-4193-8052-14da2c33e88c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-quobyte-3a92f812-7ea8-4193-8052-14da2c33e88c" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a24cd-4917-4130-bd87-ae1d77d1a142]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:29 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c Apr 30 11:02:29 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:29 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b685fd32-03d9-4c1d-be50-938b179a1c7d" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "cinder-quobyte-b685fd32-03d9-4c1d-be50-938b179a1c7d" released by "delete_volume" :: held 1.719s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Created reservations ['62f7c1eb-ae7b-46ee-850c-1ab93905e30b', 'a5afd358-487a-41d9-9e95-826aaff208b4', '914dfa61-ce69-4a4e-b629-7b3383be902a', '08276522-477f-46b1-a07b-da53778424c2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:29 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:29 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:29 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 1073741824" returned: 0 in 1.002s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:29 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 Apr 30 11:02:29 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:29 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c" returned: 0 in 0.854s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:30 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c Apr 30 11:02:30 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:30 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.801s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Deleted volume successfully. Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b30a2300-ca6b-4c16-932d-1c357c0368c8 tempest-VolumesCloneTest-72348006 None] Lock "cinder-b685fd32-03d9-4c1d-be50-938b179a1c7d-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:30 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8" returned: 0 in 0.806s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a56533-f55c-4eb4-8fda-677e9d3fb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230dceb6-9d42-4108-b2df-b8477cdb97d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86a4328-12ac-46e2-a790-dd4d44296256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:30 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Volume volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 (230dceb6-9d42-4108-b2df-b8477cdb97d8): created successfully Apr 30 11:02:30 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86a4328-12ac-46e2-a790-dd4d44296256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Flow 'volume_create_manager' (fe4424f4-9af2-4fbd-9073-53fd6bea875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3a92f812-7ea8-4193-8052-14da2c33e88c" returned: 0 in 0.825s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-quobyte-3a92f812-7ea8-4193-8052-14da2c33e88c" released by "delete_volume" :: held 1.740s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e7243d7b-aefd-4c40-a0cb-f3e7e846b4b4 tempest-VolumeQuotasAdminTestJSON-786818172 None] Created volume successfully. Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Created reservations ['09080c13-f3cd-4a05-9cbc-ea3444b8a44e', '223c3e63-dea6-46a5-958f-a7753ba0b040', 'a1328ae5-322c-45e2-a6cc-d81410b7c88f', '40903ed9-e087-42ed-9ab2-cbd04c6590f8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:31 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:31 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:31 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:31 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Deleted volume successfully. Apr 30 11:02:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5bfac17d-9432-4175-a131-bf912733a7e2 tempest-VolumesTransfersTest-1315994566 None] Lock "cinder-3a92f812-7ea8-4193-8052-14da2c33e88c-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f8ffbe14-e4be-4fd1-9ba9-f16790087295 tempest-VolumeQuotasAdminTestJSON-210596370 None] Transfer volume completed successfully. Apr 30 11:02:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Acquiring lock "cinder-230dceb6-9d42-4108-b2df-b8477cdb97d8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "cinder-230dceb6-9d42-4108-b2df-b8477cdb97d8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Acquiring lock "cinder-quobyte-230dceb6-9d42-4108-b2df-b8477cdb97d8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "cinder-quobyte-230dceb6-9d42-4108-b2df-b8477cdb97d8" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c676088-cbc9-4e2e-92d5-b11d533b3937]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Flow 'volume_create_manager' (a55df27d-2aa5-4bdf-91b7-8a31f6543874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842d2cee-026c-45ba-81d2-724d669a40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842d2cee-026c-45ba-81d2-724d669a40e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075867642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3148914c-3a1d-4dca-b802-b624dad91424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eed9ffdfd8f4da39d63ffce0f34fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:34Z,use_quota=True,user_id='dff5585022de4a0881212184025d2e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2ab83-fc84-4a7d-acc4-6b7f80488d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2ab83-fc84-4a7d-acc4-6b7f80488d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6b12ef-54ae-4127-902c-cfca2889fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:02:34 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 Apr 30 11:02:34 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6b12ef-54ae-4127-902c-cfca2889fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3148914c-3a1d-4dca-b802-b624dad91424', 'volume_name': 'volume-3148914c-3a1d-4dca-b802-b624dad91424', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b4dc76-fd69-42e2-800e-5a3297f4d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b4dc76-fd69-42e2-800e-5a3297f4d772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c9615b-7524-4d78-b7e7-e795d7c84081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Volume 3148914c-3a1d-4dca-b802-b624dad91424: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3148914c-3a1d-4dca-b802-b624dad91424', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:02:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Trying to clone 3148914c-3a1d-4dca-b802-b624dad91424 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:02:35 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:02:35 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8" returned: 0 in 1.094s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:35 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8 Apr 30 11:02:35 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[77356c5b-00d7-40fa-b987-075ebaa05825]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:35 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD Apr 30 11:02:35 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:35 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-230dceb6-9d42-4108-b2df-b8477cdb97d8" returned: 0 in 0.819s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "cinder-quobyte-230dceb6-9d42-4108-b2df-b8477cdb97d8" released by "delete_volume" :: held 1.969s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Created reservations ['9a44bb3e-93e9-44b8-9ec8-c55faf0ea56d', '81cb6ad0-b266-4890-8505-5d455a187b2f', '9ec48a4b-dd0c-493e-b569-688513fa649d', '56a44b2f-2667-41ad-91e6-5d494d7b431f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:36 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD" returned: 0 in 0.921s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user dff5585022de4a0881212184025d2e71. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:36 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:36 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7fd3af-da72-4492-a044-cc0345cf6d4f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:36 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD Apr 30 11:02:36 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:37 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.961s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Deleted volume successfully. Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c0c24dc7-9b59-43f0-9a42-36d0ec7a4f82 tempest-VolumeQuotasAdminTestJSON-213775981 None] Lock "cinder-230dceb6-9d42-4108-b2df-b8477cdb97d8-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:37 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD" returned: 0 in 0.996s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075867642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3148914c-3a1d-4dca-b802-b624dad91424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eed9ffdfd8f4da39d63ffce0f34fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:34Z,use_quota=True,user_id='dff5585022de4a0881212184025d2e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Creating volume 3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:37 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:37 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1073741824 Apr 30 11:02:37 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:38 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1073741824" returned: 0 in 1.472s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:38 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:38 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:39 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 0.808s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 3148914c-3a1d-4dca-b802-b624dad91424. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[35399363-4db4-45e0-967b-cc5bc9897811]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:39 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf Apr 30 11:02:39 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:40 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf" returned: 0 in 0.840s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:40 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf Apr 30 11:02:40 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:41 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf" returned: 1 in 0.787s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_rda254rf' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:02:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc67c0c8-64a8-4e86-abd5-2f3b9acb80aa]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:41 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD Apr 30 11:02:41 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Flow 'volume_create_manager' (df7b5116-5dd0-458a-a19d-971e3f38e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77114136-42b5-4c15-ad28-3b808616fe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77114136-42b5-4c15-ad28-3b808616fe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-646583107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aebd44a-1e23-4e1a-9420-e30790d55a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bac5991dcec485f85d00de1c0161f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:42Z,use_quota=True,user_id='cda0e1aa6f874e75a2d61961e698500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4814d6-895b-4f33-a3b7-078c848ba54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4814d6-895b-4f33-a3b7-078c848ba54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e102d9-de81-4b6e-9ff3-a22295ed39a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e102d9-de81-4b6e-9ff3-a22295ed39a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aebd44a-1e23-4e1a-9420-e30790d55a2d', 'volume_name': 'volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44a7c9-5671-424b-80d2-873bcad25511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44a7c9-5671-424b-80d2-873bcad25511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e19bc7-0c1d-4630-9ca7-28c9ecc7fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Volume 3aebd44a-1e23-4e1a-9420-e30790d55a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d', 'volume_size': 1} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-646583107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aebd44a-1e23-4e1a-9420-e30790d55a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bac5991dcec485f85d00de1c0161f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:42Z,use_quota=True,user_id='cda0e1aa6f874e75a2d61961e698500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Creating volume 3aebd44a-1e23-4e1a-9420-e30790d55a2d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:42 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:42 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d 1073741824 Apr 30 11:02:42 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:42 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD" returned: 0 in 0.961s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:02:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:42 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:42 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:43 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d 1073741824" returned: 0 in 1.142s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:43 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d Apr 30 11:02:43 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:44 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d" returned: 0 in 0.866s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e19bc7-0c1d-4630-9ca7-28c9ecc7fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee72807f-ef50-4335-9f98-4f6afd60c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Volume volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d (3aebd44a-1e23-4e1a-9420-e30790d55a2d): created successfully Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee72807f-ef50-4335-9f98-4f6afd60c348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Flow 'volume_create_manager' (df7b5116-5dd0-458a-a19d-971e3f38e047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c9b286c5-4120-4832-8818-ff956568ac91 tempest-VolumesTransfersV357Test-1604829131 None] Created volume successfully. Apr 30 11:02:44 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 2.503s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_less8oa5devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:02:44 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Converted 112.00 MB image at 44.73 MB/s Apr 30 11:02:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:44 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1G Apr 30 11:02:44 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:45 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 1G" returned: 0 in 0.711s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e7067b-6a96-43b8-b8ec-904770901b4b]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:45 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:45 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-11f979ba-67ce-4b50-adc3-7f315073d54b tempest-VolumesTransfersV357Test-866630635 None] Transfer volume completed successfully. Apr 30 11:02:46 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 1.283s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Flow 'volume_create_manager' (0458fee9-4fa9-4cdb-8a8f-aa5468df4d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1770019d-01d8-48d3-b56f-86220e8b4814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1770019d-01d8-48d3-b56f-86220e8b4814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-692360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00695667-406c-41f6-8f5c-656b9a08b5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c4b801c93486f93daf0baa1ecca9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:47Z,use_quota=True,user_id='e9834c57954c4f69b493cabc36df8855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290dd10f-4631-4f48-9a76-b3b4069dadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290dd10f-4631-4f48-9a76-b3b4069dadd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e98a76f-e906-46c0-93c5-1d5c0f7fe029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e98a76f-e906-46c0-93c5-1d5c0f7fe029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00695667-406c-41f6-8f5c-656b9a08b5d1', 'volume_name': 'volume-00695667-406c-41f6-8f5c-656b9a08b5d1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a5686d-7998-4f79-9e4c-0236485fc322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a5686d-7998-4f79-9e4c-0236485fc322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fdb666-ac3e-4c25-9ac3-dfce8d90dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Volume 00695667-406c-41f6-8f5c-656b9a08b5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00695667-406c-41f6-8f5c-656b9a08b5d1', 'volume_size': 1} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-692360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00695667-406c-41f6-8f5c-656b9a08b5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c4b801c93486f93daf0baa1ecca9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:47Z,use_quota=True,user_id='e9834c57954c4f69b493cabc36df8855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Creating volume 00695667-406c-41f6-8f5c-656b9a08b5d1 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:47 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:47 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:47 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:47 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 1073741824 Apr 30 11:02:47 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "cinder-3aebd44a-1e23-4e1a-9420-e30790d55a2d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-3aebd44a-1e23-4e1a-9420-e30790d55a2d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "cinder-quobyte-3aebd44a-1e23-4e1a-9420-e30790d55a2d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-quobyte-3aebd44a-1e23-4e1a-9420-e30790d55a2d" acquired by "delete_volume" :: waited 0.033s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13826d-ec46-43f8-8504-1c92bc8ff3ef]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:48 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d Apr 30 11:02:48 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:48 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 1 in 1.437s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 3148914c-3a1d-4dca-b802-b624dad91424 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user dff5585022de4a0881212184025d2e71 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Marking volume 3148914c-3a1d-4dca-b802-b624dad91424 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to 3148914c-3a1d-4dca-b802-b624dad91424. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Creating volume glance metadata for volume 3148914c-3a1d-4dca-b802-b624dad91424 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c9615b-7524-4d78-b7e7-e795d7c84081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3148914c-3a1d-4dca-b802-b624dad91424', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d1e5a4-89a9-4b3f-a45b-56dd4c13267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Volume volume-3148914c-3a1d-4dca-b802-b624dad91424 (3148914c-3a1d-4dca-b802-b624dad91424): created successfully Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d1e5a4-89a9-4b3f-a45b-56dd4c13267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Flow 'volume_create_manager' (a55df27d-2aa5-4bdf-91b7-8a31f6543874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6cd9e0fe-56d4-40f5-9399-39db2cdacf9e tempest-VolumesExtendTest-2118921627 None] Created volume successfully. Apr 30 11:02:48 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 1073741824" returned: 0 in 1.518s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:48 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 Apr 30 11:02:48 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:49 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d" returned: 0 in 1.411s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:49 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d Apr 30 11:02:49 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:49 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1" returned: 0 in 0.846s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.310s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fdb666-ac3e-4c25-9ac3-dfce8d90dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00695667-406c-41f6-8f5c-656b9a08b5d1', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f49ad3-2487-4829-9430-19786a9651f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Volume volume-00695667-406c-41f6-8f5c-656b9a08b5d1 (00695667-406c-41f6-8f5c-656b9a08b5d1): created successfully Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f49ad3-2487-4829-9430-19786a9651f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Flow 'volume_create_manager' (0458fee9-4fa9-4cdb-8a8f-aa5468df4d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae4773-9644-448b-aa4b-217e6bfb1f9f]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e1db4585-e4b6-4a13-b4bc-847a0d2c0844 tempest-VolumesServicesTestJSON-1766984548 None] Created volume successfully. Apr 30 11:02:49 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:49 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:50 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3aebd44a-1e23-4e1a-9420-e30790d55a2d" returned: 0 in 0.755s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-quobyte-3aebd44a-1e23-4e1a-9420-e30790d55a2d" released by "delete_volume" :: held 2.263s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Created reservations ['22f573c4-83b4-4d12-b5ac-8dd106c9b1f1', 'a8224149-220e-47a7-92e1-2755cb7be285', '0f93fac6-92a6-4027-b272-ae75abc2d668', '307068d9-edb1-4036-ac65-2a7f3165e89e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:50 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:50 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Acquiring lock "cinder-00695667-406c-41f6-8f5c-656b9a08b5d1-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "cinder-00695667-406c-41f6-8f5c-656b9a08b5d1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Acquiring lock "cinder-quobyte-00695667-406c-41f6-8f5c-656b9a08b5d1" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "cinder-quobyte-00695667-406c-41f6-8f5c-656b9a08b5d1" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c7b6b8-28ae-4b43-80b8-4fc06e834769]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:50 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 1.222s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:51 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 Apr 30 11:02:51 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:51 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:51 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:51 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.902s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Deleted volume successfully. Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-20b319f6-92ff-462e-ac7a-bd73566cbaaf tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-3aebd44a-1e23-4e1a-9420-e30790d55a2d-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:INSERT=51,cinder:SELECT=122,cinder:UPDATE=139,cinder:DELETE=13 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Flow 'volume_create_manager' (f2a6de18-8fae-49a2-9646-273e3a940e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e686e7-33e8-445e-8ca8-2905c2488c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e686e7-33e8-445e-8ca8-2905c2488c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062858876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825e4701-d194-48f7-89ac-8117ae486a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bac5991dcec485f85d00de1c0161f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:52Z,use_quota=True,user_id='cda0e1aa6f874e75a2d61961e698500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9d06ed-566d-4946-9d63-347636fcda32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9d06ed-566d-4946-9d63-347636fcda32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609cf135-0bdc-4daf-87ee-fe77c9ea085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609cf135-0bdc-4daf-87ee-fe77c9ea085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825e4701-d194-48f7-89ac-8117ae486a52', 'volume_name': 'volume-825e4701-d194-48f7-89ac-8117ae486a52', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51c08c8-63f3-43c3-8e00-7f2666a6d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51c08c8-63f3-43c3-8e00-7f2666a6d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467c6c70-9c8a-4a7a-821b-b38a5efed9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Volume 825e4701-d194-48f7-89ac-8117ae486a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825e4701-d194-48f7-89ac-8117ae486a52', 'volume_size': 1} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:52 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:52 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1" returned: 0 in 1.216s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 1 in 1.167s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 2G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:52 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1 Apr 30 11:02:52 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 2G" returned: 0 in 0.070s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.537s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062858876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825e4701-d194-48f7-89ac-8117ae486a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bac5991dcec485f85d00de1c0161f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:52Z,use_quota=True,user_id='cda0e1aa6f874e75a2d61961e698500a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Creating volume 825e4701-d194-48f7-89ac-8117ae486a52 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:52 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 1073741824 Apr 30 11:02:52 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6a5a5f95-b5c7-47ad-b21d-1e22d1cfc4c6 tempest-VolumesExtendTest-2118921627 None] Extend volume completed successfully. Apr 30 11:02:52 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-00695667-406c-41f6-8f5c-656b9a08b5d1" returned: 0 in 0.657s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "cinder-quobyte-00695667-406c-41f6-8f5c-656b9a08b5d1" released by "delete_volume" :: held 1.952s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Created reservations ['d0c56c9e-4ff5-48aa-b5ba-e491c62c94ac', '6054621d-af9a-466c-9ba6-866d6c18dfd5', '822bfd93-93f3-40ef-96d9-237cc7a56827', '7f9cb89c-267d-4f7d-a7b1-66e29f27f07a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:53 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:53 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-3148914c-3a1d-4dca-b802-b624dad91424-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "cinder-3148914c-3a1d-4dca-b802-b624dad91424-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-quobyte-3148914c-3a1d-4dca-b802-b624dad91424" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-3148914c-3a1d-4dca-b802-b624dad91424" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:53 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 1073741824" returned: 0 in 1.170s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8d664-bcd0-4f9e-9727-51ac8e8be41e]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:53 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 Apr 30 11:02:53 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:53 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:53 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:54 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467c6c70-9c8a-4a7a-821b-b38a5efed9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825e4701-d194-48f7-89ac-8117ae486a52', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347cdff-2a09-4789-9c2e-a598f990ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:54 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.273s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Deleted volume successfully. Apr 30 11:02:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Volume volume-825e4701-d194-48f7-89ac-8117ae486a52 (825e4701-d194-48f7-89ac-8117ae486a52): created successfully Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5347cdff-2a09-4789-9c2e-a598f990ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Flow 'volume_create_manager' (f2a6de18-8fae-49a2-9646-273e3a940e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b5c60adf-dfdd-4a21-b600-9574093b63df tempest-VolumesServicesTestJSON-1766984548 None] Lock "cinder-00695667-406c-41f6-8f5c-656b9a08b5d1-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2966b9df-0b07-4c0f-aace-d189fb93c7d8 tempest-VolumesTransfersV357Test-1604829131 None] Created volume successfully. Apr 30 11:02:54 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 1.128s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:54 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:54 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:55 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 1 in 0.782s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:55 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424 Apr 30 11:02:55 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "cinder-825e4701-d194-48f7-89ac-8117ae486a52-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-825e4701-d194-48f7-89ac-8117ae486a52-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "cinder-quobyte-825e4701-d194-48f7-89ac-8117ae486a52" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-quobyte-825e4701-d194-48f7-89ac-8117ae486a52" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0b5449-f8d0-4832-8c12-61c4ff837961]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:02:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:56 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 Apr 30 11:02:56 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:56 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3148914c-3a1d-4dca-b802-b624dad91424" returned: 0 in 0.975s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-3148914c-3a1d-4dca-b802-b624dad91424" released by "delete_volume" :: held 3.006s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Created reservations ['724f0de8-4a49-4cbc-b1ee-a34cf81b38a7', '287a0a5d-ea4c-4aec-a99a-977561a0d007', 'f6826ca5-5cca-4e99-96ff-3464f01fcdc1', 'cac416b4-af86-4f15-93c4-2f2df381e55d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:56 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:56 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:57 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52" returned: 0 in 1.386s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:57 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52 Apr 30 11:02:57 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Flow 'volume_create_manager' (6d3b6efd-fd5e-4866-ae68-93478d25f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c89037a-ca06-40b6-a9c4-4c6c05413c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c89037a-ca06-40b6-a9c4-4c6c05413c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1839856329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c05d9f-f182-4fcc-8a4b-cd3515a77594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eed9ffdfd8f4da39d63ffce0f34fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:57Z,use_quota=True,user_id='dff5585022de4a0881212184025d2e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eed3e87-7f98-4683-b380-76052eec5c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eed3e87-7f98-4683-b380-76052eec5c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca23dc52-2ea8-48a4-8f7b-5e69481d0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca23dc52-2ea8-48a4-8f7b-5e69481d0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c05d9f-f182-4fcc-8a4b-cd3515a77594', 'volume_name': 'volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff47a87a-1417-4c36-8a12-82e4443ebd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff47a87a-1417-4c36-8a12-82e4443ebd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd96ba9-c4d6-46bb-8bd0-7f51641bfa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Volume e3c05d9f-f182-4fcc-8a4b-cd3515a77594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594', 'volume_size': 1} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1839856329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c05d9f-f182-4fcc-8a4b-cd3515a77594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eed9ffdfd8f4da39d63ffce0f34fd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:02:57Z,use_quota=True,user_id='dff5585022de4a0881212184025d2e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Creating volume e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:02:57 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:57 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 1073741824 Apr 30 11:02:57 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:57 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.092s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Deleted volume successfully. Apr 30 11:02:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cd2345ea-2fe0-4934-980b-d02a388b517d tempest-VolumesExtendTest-2118921627 None] Lock "cinder-3148914c-3a1d-4dca-b802-b624dad91424-delete_volume" released by "delete_volume" :: held 4.547s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:58 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-825e4701-d194-48f7-89ac-8117ae486a52" returned: 0 in 0.957s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-quobyte-825e4701-d194-48f7-89ac-8117ae486a52" released by "delete_volume" :: held 2.404s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Created reservations ['8130aa01-00fa-4aa2-83d8-66d2c4a81072', 'bc5b652a-83d4-4dca-b7d4-44c18a22d50a', '3d9fc14a-1e3a-48e7-bb53-9e60a278f9cb', '07d79e8d-7800-4f97-bee4-9827a90ae84b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:58 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:02:58 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:58 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 1073741824" returned: 0 in 1.066s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:58 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:02:58 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:59 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.793s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Deleted volume successfully. Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b38863de-2238-40c2-9db6-d0b36ffafa36 tempest-VolumesTransfersV357Test-1945746366 None] Lock "cinder-825e4701-d194-48f7-89ac-8117ae486a52-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:02:59 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd96ba9-c4d6-46bb-8bd0-7f51641bfa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329d5c23-41d1-425c-be77-d1fa190fba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:02:59 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Volume volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 (e3c05d9f-f182-4fcc-8a4b-cd3515a77594): created successfully Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329d5c23-41d1-425c-be77-d1fa190fba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:02:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Flow 'volume_create_manager' (6d3b6efd-fd5e-4866-ae68-93478d25f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:02:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4f6f9b5e-f78e-4a22-bb02-a34ee3bf07ae tempest-VolumesExtendTest-2118921627 None] Created volume successfully. Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Flow 'volume_create_manager' (b1f29c6d-ebf4-468c-a8f8-b76ddfdef825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59e78b-1ce7-4da7-932e-e36653bbb510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59e78b-1ce7-4da7-932e-e36653bbb510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136004838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400506ab-7ada-4b49-9158-166417da15d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef849787af244348fa231657dad54bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:00Z,use_quota=True,user_id='3dcd571c99dc409eb15ac5670a7a1386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c285c5d-bf53-431f-8d46-43dd849f33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c285c5d-bf53-431f-8d46-43dd849f33b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84843988-876a-4ab1-aa27-487f042ea4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84843988-876a-4ab1-aa27-487f042ea4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400506ab-7ada-4b49-9158-166417da15d8', 'volume_name': 'volume-400506ab-7ada-4b49-9158-166417da15d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ce2b0-66ed-4208-b65d-8387d52db9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ce2b0-66ed-4208-b65d-8387d52db9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89a4f6-509f-41c3-87aa-2c31b7c21423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:00 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Volume 400506ab-7ada-4b49-9158-166417da15d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400506ab-7ada-4b49-9158-166417da15d8', 'volume_size': 1} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136004838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400506ab-7ada-4b49-9158-166417da15d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef849787af244348fa231657dad54bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:00Z,use_quota=True,user_id='3dcd571c99dc409eb15ac5670a7a1386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Creating volume 400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:03:00 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:00 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 1073741824 Apr 30 11:03:00 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:01 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 1073741824" returned: 0 in 0.879s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:01 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 Apr 30 11:03:01 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:02 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8" returned: 0 in 0.648s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.510s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89a4f6-509f-41c3-87aa-2c31b7c21423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400506ab-7ada-4b49-9158-166417da15d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb6b895-3a0f-49fd-9721-aaa4b5ba510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Creating offline snapshot b0974ea7-28ba-401b-a17f-ac56bffd3192 of volume e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:03:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Volume volume-400506ab-7ada-4b49-9158-166417da15d8 (400506ab-7ada-4b49-9158-166417da15d8): created successfully Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb6b895-3a0f-49fd-9721-aaa4b5ba510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Flow 'volume_create_manager' (b1f29c6d-ebf4-468c-a8f8-b76ddfdef825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9007d93-49ad-4bb1-8713-578ad16cf5c8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1a9c3feb-5d18-4e41-b5c4-116314b69dee tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Created volume successfully. Apr 30 11:03:02 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:03:02 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:03 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.845s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:03 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 1G Apr 30 11:03:03 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:04 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 1G" returned: 0 in 0.803s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:04 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 Apr 30 11:03:04 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:04 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192" returned: 0 in 0.631s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:04 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 is being set with open permissions: ugo+rw Apr 30 11:03:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:04 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 Apr 30 11:03:04 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:05 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192" returned: 0 in 0.669s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:05 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info Apr 30 11:03:05 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:06 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info" returned: 0 in 0.662s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:06 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info is being set with open permissions: ugo+rw Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:06 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:03:06 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:06 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info Apr 30 11:03:06 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:06 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:06 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.info" returned: 0 in 0.665s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.417s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.830s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Creating offline snapshot f3c2326a-223a-4e36-8891-5e43dc88fa7e of volume 400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:03:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-84717d41-1da9-49d5-9876-1b84fc631ce1 tempest-VolumesExtendTest-2118921627 None] Create snapshot completed successfully Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca2701-2bae-4941-84cc-0f7ddc6d0d6a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:06 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 Apr 30 11:03:06 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:07 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8" returned: 0 in 0.853s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:07 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e 1G Apr 30 11:03:07 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:08 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e 1G" returned: 0 in 1.015s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400506ab-7ada-4b49-9158-166417da15d8 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:08 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400506ab-7ada-4b49-9158-166417da15d8 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e Apr 30 11:03:08 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:09 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400506ab-7ada-4b49-9158-166417da15d8 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:09 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e is being set with open permissions: ugo+rw Apr 30 11:03:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:09 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e Apr 30 11:03:09 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:10 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e" returned: 0 in 0.677s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:10 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info Apr 30 11:03:10 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:10 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info" returned: 0 in 0.640s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:10 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info is being set with open permissions: ugo+rw Apr 30 11:03:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:10 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info Apr 30 11:03:10 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:11 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.info" returned: 0 in 0.625s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.121s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a086e736-8b57-4bfe-a935-e28999381558]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cd65650c-b024-43f0-a735-366ca4abadd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Create snapshot completed successfully Apr 30 11:03:11 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:03:11 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:12 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.851s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 2G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 2G" returned: 0 in 0.180s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.092s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ae0983c4-f72d-44b2-bbdf-c3ca396808b8 tempest-VolumesExtendTest-2118921627 None] Extend volume completed successfully. Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-b0974ea7-28ba-401b-a17f-ac56bffd3192-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "cinder-f3c2326a-223a-4e36-8891-5e43dc88fa7e-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-f3c2326a-223a-4e36-8891-5e43dc88fa7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-b0974ea7-28ba-401b-a17f-ac56bffd3192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-quobyte-b0974ea7-28ba-401b-a17f-ac56bffd3192" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "cinder-quobyte-f3c2326a-223a-4e36-8891-5e43dc88fa7e" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-b0974ea7-28ba-401b-a17f-ac56bffd3192" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Deleting offline snapshot b0974ea7-28ba-401b-a17f-ac56bffd3192 of volume e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] snapshot_file for this snap is: volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-f3c2326a-223a-4e36-8891-5e43dc88fa7e" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Deleting offline snapshot f3c2326a-223a-4e36-8891-5e43dc88fa7e of volume 400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] snapshot_file for this snap is: volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d2d8f-f828-4e21-b921-01e32e186a91]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62da5db-58be-478c-9ad6-079610330f88]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-40b3b66a-1ced-46cd-b099-201bab1611b5 req-a92277b4-2b3e-4da7-9979-ef0603c569f4 tempest-AttachVolumeShelveTestJSON-1896847819 None] Terminate volume connection completed successfully. Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-40b3b66a-1ced-46cd-b099-201bab1611b5 req-a92277b4-2b3e-4da7-9979-ef0603c569f4 tempest-AttachVolumeShelveTestJSON-1896847819 None] Deleting attachment 517e4e6b-e9ec-4e12-a0e2-e862b9a061b3. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:03:13 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 Apr 30 11:03:13 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:13 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e Apr 30 11:03:13 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:13 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:13 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400506ab-7ada-4b49-9158-166417da15d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192" returned: 0 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485d6b1-ba9b-4db7-b27a-7f183864eda0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5af39e-41e4-4dfd-a10b-346ec1e2f63d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:14 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 Apr 30 11:03:14 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:14 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:03:14 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:14 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8" returned: 0 in 0.953s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:14 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.955s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:15 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e Apr 30 11:03:15 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:15 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 Apr 30 11:03:15 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:16 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e" returned: 0 in 1.057s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:16 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:16 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e Apr 30 11:03:16 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192" returned: 0 in 1.083s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:16 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192 Apr 30 11:03:16 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (5c4de5c4-6459-4f46-8319-a484bccfc26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc51bcab-2efc-4d83-a869-fbe38e0b7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc51bcab-2efc-4d83-a869-fbe38e0b7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429874523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7903a5e3-075f-43dd-bc87-bc64174d7eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:16Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edace8fb-9a7e-455d-af75-5c70bbc81603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edace8fb-9a7e-455d-af75-5c70bbc81603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4382a-7384-440f-8cd7-5bc9fc5358ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4382a-7384-440f-8cd7-5bc9fc5358ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7903a5e3-075f-43dd-bc87-bc64174d7eb3', 'volume_name': 'volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd26655-4edd-49f2-9bca-1d7da6ffd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd26655-4edd-49f2-9bca-1d7da6ffd377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bae4a4-f31b-4d2f-b286-9e9dfd54741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:16 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume 7903a5e3-075f-43dd-bc87-bc64174d7eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3', 'volume_size': 1} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429874523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7903a5e3-075f-43dd-bc87-bc64174d7eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:16Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating volume 7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:03:16 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:16 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 1073741824 Apr 30 11:03:16 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:16 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594.b0974ea7-28ba-401b-a17f-ac56bffd3192" returned: 0 in 0.859s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-b0974ea7-28ba-401b-a17f-ac56bffd3192" released by "_delete_snapshot" :: held 3.918s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" released by "delete_snapshot" :: held 3.974s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8.f3c2326a-223a-4e36-8891-5e43dc88fa7e" returned: 0 in 1.050s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Created reservations ['b07ff569-3c4f-466b-99cf-e8bf5676338f', 'bf05c88a-c49b-4454-bb2e-86125cadb253', 'fee8a892-4327-4ae9-af61-270aa48cba30', '27a1b7ef-56b9-4328-9b09-ec36ad83f21e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-f3c2326a-223a-4e36-8891-5e43dc88fa7e" released by "_delete_snapshot" :: held 4.035s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" released by "delete_snapshot" :: held 4.112s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Delete snapshot completed successfully. Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fa7dc2dd-c8f5-4ae9-ab22-5484d1905742 tempest-VolumesExtendTest-2118921627 None] Lock "cinder-b0974ea7-28ba-401b-a17f-ac56bffd3192-delete_snapshot" released by "delete_snapshot" :: held 4.239s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Created reservations ['7eaa05f2-a348-43ab-896e-0fd3c6688460', 'a64bd82e-cab2-46eb-a3cf-b0067f817dd2', '53b69e5f-b60d-46ca-8840-00090407c330', 'cd832eb9-c435-4d97-8577-428e60d51718'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:03:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Delete snapshot completed successfully. Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8097856-2ff8-4aa9-a5b0-90f81fbe8c3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-f3c2326a-223a-4e36-8891-5e43dc88fa7e-delete_snapshot" released by "delete_snapshot" :: held 4.409s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-e3c05d9f-f182-4fcc-8a4b-cd3515a77594-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "cinder-e3c05d9f-f182-4fcc-8a4b-cd3515a77594-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Acquiring lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af599d-f410-4773-b16a-657028c7e437]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:17 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:03:17 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:17 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 1073741824" returned: 0 in 1.063s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:17 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 Apr 30 11:03:17 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "cinder-400506ab-7ada-4b49-9158-166417da15d8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:18 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-400506ab-7ada-4b49-9158-166417da15d8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.817s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:18 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3" returned: 0 in 0.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:18 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594 Apr 30 11:03:18 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bae4a4-f31b-4d2f-b286-9e9dfd54741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf6f2f-20dc-4946-b3d5-1b57b55fa979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:18 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 (7903a5e3-075f-43dd-bc87-bc64174d7eb3): created successfully Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf6f2f-20dc-4946-b3d5-1b57b55fa979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (5c4de5c4-6459-4f46-8319-a484bccfc26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cda99aaa-14eb-4a34-947f-263d222c8dd0 tempest-VolumesSnapshotTestJSON-1758433644 None] Created volume successfully. Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7f8339-3234-4736-b72e-240dd1752463]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:18 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 Apr 30 11:03:18 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:19 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "cinder-quobyte-e3c05d9f-f182-4fcc-8a4b-cd3515a77594" released by "delete_volume" :: held 1.632s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Created reservations ['125392fe-4d30-4fd7-a832-db62150cf474', 'de6ff79d-3142-4bc7-a26a-814ed704d50d', '56ee5366-34ed-47db-a2b2-4f2bd6c9837d', '4de95b16-692d-42b5-a247-8c99d1678244'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:19 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:03:19 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:19 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8" returned: 0 in 0.853s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:19 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8 Apr 30 11:03:19 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:20 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.715s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Deleted volume successfully. Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df6b9034-20f7-4a78-80b9-6385e31c031e tempest-VolumesExtendTest-2118921627 None] Lock "cinder-e3c05d9f-f182-4fcc-8a4b-cd3515a77594-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating offline snapshot 776fd8cc-1cd0-4dbc-a651-5387120995d6 of volume 7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7b993-01d5-472a-a703-686837dcb50d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:20 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-400506ab-7ada-4b49-9158-166417da15d8" returned: 0 in 0.770s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-quobyte-400506ab-7ada-4b49-9158-166417da15d8" released by "delete_volume" :: held 1.690s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:20 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 Apr 30 11:03:20 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Created reservations ['b6e9d7d8-b6b5-48ba-ae07-a24044d23321', '1c24fa58-d1da-4e6a-8893-ba054fd64acb', 'aef1cc82-be07-4bb7-a7db-fcc6dc0fdcdd', 'c6a61467-4286-4e80-9c1d-a9f8204e6bfa'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:20 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:03:20 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:20 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3" returned: 0 in 0.842s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:21 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 1G Apr 30 11:03:21 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:21 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.786s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:21 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:21 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Deleted volume successfully. Apr 30 11:03:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aad0d19f-8832-4253-a292-7410b874ab73 tempest-VolumeSnapshotQuotasNegativeTestJSON-1244580687 None] Lock "cinder-400506ab-7ada-4b49-9158-166417da15d8-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:21 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 1G" returned: 0 in 0.962s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:21 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 Apr 30 11:03:21 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:22 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:22 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 is being set with open permissions: ugo+rw Apr 30 11:03:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:22 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 Apr 30 11:03:22 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:23 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6" returned: 0 in 0.823s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:23 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=139,cinder:SELECT=109,cinder:INSERT=34,cinder:DELETE=13 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:03:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:23 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info Apr 30 11:03:23 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:24 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:24 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info is being set with open permissions: ugo+rw Apr 30 11:03:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:24 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info Apr 30 11:03:24 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:25 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.info" returned: 0 in 0.796s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.064s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d6e101ef-60d4-4303-967e-2ef4df54e413 tempest-VolumesSnapshotTestJSON-1758433644 None] Create snapshot completed successfully Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-776fd8cc-1cd0-4dbc-a651-5387120995d6-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-776fd8cc-1cd0-4dbc-a651-5387120995d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-776fd8cc-1cd0-4dbc-a651-5387120995d6" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-776fd8cc-1cd0-4dbc-a651-5387120995d6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Deleting offline snapshot 776fd8cc-1cd0-4dbc-a651-5387120995d6 of volume 7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] snapshot_file for this snap is: volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0385e8e-22a4-43a8-acba-bdf9be341450]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:26 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 Apr 30 11:03:26 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Flow 'volume_create_manager' (15e4a57f-6b6d-4b95-85b2-121c651411d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6b9720-dc0c-4569-bfb1-616707c37095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6b9720-dc0c-4569-bfb1-616707c37095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1636932407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f86cec-fbd2-4d1a-a62c-17e822faf48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71937c16d5e44dfbab32c26385a4fd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:27Z,use_quota=True,user_id='1461417febd246f681909c8b50371e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38748dfb-94c1-4a13-a95e-18be4efad8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38748dfb-94c1-4a13-a95e-18be4efad8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d5deb4-5347-49e0-b499-c0c6bc1c684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d5deb4-5347-49e0-b499-c0c6bc1c684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85f86cec-fbd2-4d1a-a62c-17e822faf48e', 'volume_name': 'volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bfa72d-ff98-4f47-b10f-bbbe4c59ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bfa72d-ff98-4f47-b10f-bbbe4c59ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8043dc-595e-4847-877e-04226b2b1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:27 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Volume 85f86cec-fbd2-4d1a-a62c-17e822faf48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e', 'volume_size': 1} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1636932407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f86cec-fbd2-4d1a-a62c-17e822faf48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71937c16d5e44dfbab32c26385a4fd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:27Z,use_quota=True,user_id='1461417febd246f681909c8b50371e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Creating volume 85f86cec-fbd2-4d1a-a62c-17e822faf48e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:03:27 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:27 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e 1073741824 Apr 30 11:03:27 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:27 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6" returned: 0 in 0.920s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b634c-f029-425d-ae17-16626114b800]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:27 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 Apr 30 11:03:27 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:28 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e 1073741824" returned: 0 in 1.108s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:28 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e Apr 30 11:03:28 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:28 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3" returned: 0 in 0.893s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:28 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 Apr 30 11:03:28 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:28 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e" returned: 0 in 0.642s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8043dc-595e-4847-877e-04226b2b1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734c4839-dffd-4421-9ec9-6e61e991e34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Volume volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e (85f86cec-fbd2-4d1a-a62c-17e822faf48e): created successfully Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734c4839-dffd-4421-9ec9-6e61e991e34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Flow 'volume_create_manager' (15e4a57f-6b6d-4b95-85b2-121c651411d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b0e7ad30-87f0-4911-85f6-2fdf76c29dac tempest-VolumesNegativeTest-561688631 None] Created volume successfully. Apr 30 11:03:29 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6" returned: 0 in 0.882s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:29 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6 Apr 30 11:03:29 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:30 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3.776fd8cc-1cd0-4dbc-a651-5387120995d6" returned: 0 in 0.880s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-776fd8cc-1cd0-4dbc-a651-5387120995d6" released by "_delete_snapshot" :: held 3.765s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" released by "delete_snapshot" :: held 3.806s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:30 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['7296cdf0-a59b-400b-a22c-4854696ba231', '672ffefb-e9c3-4830-8f68-466872458074', 'd8527203-2f55-4094-abd9-8d536fba719a', 'efa86bed-7855-457f-a2ae-432766454956'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:03:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Delete snapshot completed successfully. Apr 30 11:03:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2df7ce6f-c48e-4fe6-9d06-565e8955113f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-776fd8cc-1cd0-4dbc-a651-5387120995d6-delete_snapshot" released by "delete_snapshot" :: held 4.117s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (c130d21a-0802-485a-a468-c21862ea482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791181e0-503d-485f-bd53-8449af1a8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791181e0-503d-485f-bd53-8449af1a8235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1125311686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dfbb53-b80a-440c-a8be-2caee46da32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:31Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc91b64d-c7d3-46e9-b325-ac282c28bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc91b64d-c7d3-46e9-b325-ac282c28bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080b26fe-55ec-4569-9600-663700836b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080b26fe-55ec-4569-9600-663700836b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dfbb53-b80a-440c-a8be-2caee46da32f', 'volume_name': 'volume-c8dfbb53-b80a-440c-a8be-2caee46da32f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35948d1-a283-48df-89b4-0c68fa0580ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35948d1-a283-48df-89b4-0c68fa0580ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018c54b4-3d3f-405e-a8ce-7f0898903752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume c8dfbb53-b80a-440c-a8be-2caee46da32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dfbb53-b80a-440c-a8be-2caee46da32f', 'volume_size': 1} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1125311686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dfbb53-b80a-440c-a8be-2caee46da32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:31Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating volume c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:03:31 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:03:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:31 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f 1073741824 Apr 30 11:03:31 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:32 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f 1073741824" returned: 0 in 1.096s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:32 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:03:32 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:33 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 0.855s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018c54b4-3d3f-405e-a8ce-7f0898903752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dfbb53-b80a-440c-a8be-2caee46da32f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3636b-05d2-4dee-bc3e-38dcec3c5d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume volume-c8dfbb53-b80a-440c-a8be-2caee46da32f (c8dfbb53-b80a-440c-a8be-2caee46da32f): created successfully Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3636b-05d2-4dee-bc3e-38dcec3c5d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (c130d21a-0802-485a-a468-c21862ea482d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:33 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9022faf7-66dd-408a-9348-3f7a6de86476 tempest-VolumesSnapshotTestJSON-1758433644 None] Created volume successfully. Apr 30 11:03:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Creating offline snapshot 2f855ed7-157d-4b5f-bef8-fad03ace58fe of volume c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:03:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11bb8d8-9017-4c55-81ec-cf19ab9fb0c7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:35 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:03:35 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:36 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 0.945s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:36 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe 1G Apr 30 11:03:36 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:37 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe 1G" returned: 0 in 1.225s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dfbb53-b80a-440c-a8be-2caee46da32f -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:37 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dfbb53-b80a-440c-a8be-2caee46da32f -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:03:37 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:38 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8dfbb53-b80a-440c-a8be-2caee46da32f -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 0.876s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:38 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe is being set with open permissions: ugo+rw Apr 30 11:03:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:38 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:03:38 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:38 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 0.682s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:39 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info Apr 30 11:03:39 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:39 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info" returned: 0 in 0.742s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:39 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info is being set with open permissions: ugo+rw Apr 30 11:03:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:39 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info Apr 30 11:03:39 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:40 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.info" returned: 0 in 0.613s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.226s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f1f05a81-383c-4888-a6de-915b0f198c5a tempest-VolumesSnapshotTestJSON-1758433644 None] Create snapshot completed successfully Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (40f56908-7808-4df3-9257-57c6f4b4cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d521052a-9af5-48f9-866e-f88aa01b8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d521052a-9af5-48f9-866e-f88aa01b8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1793412549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83682768-1b5f-47a9-a46f-fbaf0c09d6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:03:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2f855ed7-157d-4b5f-bef8-fad03ace58fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:03:42Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe5deb9-d411-4618-84c7-b0adbf8852f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe5deb9-d411-4618-84c7-b0adbf8852f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f6fb54-4af0-438a-bac9-4b66e189cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f6fb54-4af0-438a-bac9-4b66e189cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83682768-1b5f-47a9-a46f-fbaf0c09d6f7', 'volume_name': 'volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7', 'volume_size': 2, 'snapshot_id': '2f855ed7-157d-4b5f-bef8-fad03ace58fe'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dca8f3-d78c-43b5-aa3c-e0bb415c0057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dca8f3-d78c-43b5-aa3c-e0bb415c0057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a13ecf-8580-4466-9c32-5ec44e908606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume 83682768-1b5f-47a9-a46f-fbaf0c09d6f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7', 'volume_size': 2, 'snapshot_id': '2f855ed7-157d-4b5f-bef8-fad03ace58fe'} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating volume 83682768-1b5f-47a9-a46f-fbaf0c09d6f7 from snapshot 2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] snapshot: 2f855ed7-157d-4b5f-bef8-fad03ace58fe, volume: 83682768-1b5f-47a9-a46f-fbaf0c09d6f7, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0dd880-c6b7-4433-aaeb-81365d2a6a4a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:42 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:03:42 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:44 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 1.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8dfbb53-b80a-440c-a8be-2caee46da32f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5452e1-7131-4fb1-886a-9e8638287769]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:44 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:03:44 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:45 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 1.040s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:45 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:03:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:45 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 Apr 30 11:03:45 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:52 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=80,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=6 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:03:52 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=19,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:03:56 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" returned: 0 in 10.612s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f816722-1828-4c5d-9dee-2978fffe5f39]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:03:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:56 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:03:56 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:58 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 1.947s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:58 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f, size 1024.00 MB, duration 10.62 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:03:58 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Converted 1024.00 MB image at 96.46 MB/s Apr 30 11:03:58 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 is being set with open permissions: ugo+rw Apr 30 11:03:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:58 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 Apr 30 11:03:58 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:59 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" returned: 0 in 0.766s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" released by "_copy_volume_from_snapshot" :: held 16.491s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" released by "_create_volume_from_snapshot" :: held 16.560s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.586s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a13ecf-8580-4466-9c32-5ec44e908606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7', 'volume_size': 2, 'snapshot_id': '2f855ed7-157d-4b5f-bef8-fad03ace58fe'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89448b47-e893-401e-b257-0d9904874dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:03:59 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Volume volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 (83682768-1b5f-47a9-a46f-fbaf0c09d6f7): created successfully Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89448b47-e893-401e-b257-0d9904874dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:03:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (40f56908-7808-4df3-9257-57c6f4b4cefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:03:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f9dd6759-9ef9-4431-a037-33a08cd86e47 tempest-VolumesSnapshotTestJSON-1758433644 None] Created volume successfully. Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-83682768-1b5f-47a9-a46f-fbaf0c09d6f7-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-83682768-1b5f-47a9-a46f-fbaf0c09d6f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439420b-1713-4509-af9a-71496e7bd3b2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:00 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 Apr 30 11:04:00 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:01 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" returned: 0 in 0.878s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:01 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7 Apr 30 11:04:01 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:02 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" returned: 0 in 0.681s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-83682768-1b5f-47a9-a46f-fbaf0c09d6f7" released by "delete_volume" :: held 1.608s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['024e1a04-91dc-47ee-bb36-8951b45e90da', 'c7f208f5-c35d-43d6-95cf-3a72ba5c7b2f', '624ac575-cedb-4a3a-b256-bc40a16f922d', '82f5c85a-6fa8-4723-b2f1-3ce7d1d121f2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:02 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:02 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-2f855ed7-157d-4b5f-bef8-fad03ace58fe-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-2f855ed7-157d-4b5f-bef8-fad03ace58fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Deleting offline snapshot 2f855ed7-157d-4b5f-bef8-fad03ace58fe of volume c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] snapshot_file for this snap is: volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c2e3f3-056a-4481-aa11-ab0f5e9b6ec4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:02 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.741s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:02 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Deleted volume successfully. Apr 30 11:04:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a56f39f7-68ed-49f7-9ef8-75077c8b6e25 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-83682768-1b5f-47a9-a46f-fbaf0c09d6f7-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:03 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:04:03 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:03 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 0.788s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8dfbb53-b80a-440c-a8be-2caee46da32f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:04:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5af772-5071-47c8-9bd6-78240f2aecd6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:03 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:04:03 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:04 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 0.828s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:04 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:04:04 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:05 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 0.900s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:05 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe Apr 30 11:04:05 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:06 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:06 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:06 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f.2f855ed7-157d-4b5f-bef8-fad03ace58fe" returned: 0 in 0.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-2f855ed7-157d-4b5f-bef8-fad03ace58fe" released by "_delete_snapshot" :: held 3.510s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" released by "delete_snapshot" :: held 3.558s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['3d99a6b2-1597-4058-b12f-442a444214c8', 'da7438db-81a9-46a4-ad7e-b2137e4e6e93', '8b912520-d41f-43b2-a745-6ee28ecf09d4', 'b0a337da-855a-4c6b-8922-64a78adc6c40'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Delete snapshot completed successfully. Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0dfbd05d-4964-4ef4-88fd-85c0c17c462b tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-2f855ed7-157d-4b5f-bef8-fad03ace58fe-delete_snapshot" released by "delete_snapshot" :: held 3.764s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:06 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.827s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-c8dfbb53-b80a-440c-a8be-2caee46da32f-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-c8dfbb53-b80a-440c-a8be-2caee46da32f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b7fe3-7114-4dce-ae28-880b226bd272]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:07 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:04:07 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Flow 'volume_create_manager' (84948d7c-0a15-4f11-b543-4c5ac2dc39a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ce56b7-0e8d-4b3d-8085-9fcd908ebc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ce56b7-0e8d-4b3d-8085-9fcd908ebc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2119499613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d14eed0-85d2-4b78-b994-a425f67fe5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c501577182a04b4eb10f7eea165905c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:08Z,use_quota=True,user_id='45ecebfc6eec4fd59cbe7f045d10933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ce234-6594-47a1-a448-ce3ddacafbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ce234-6594-47a1-a448-ce3ddacafbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e5d22-5e5c-4a9f-87ac-db06947e5c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e5d22-5e5c-4a9f-87ac-db06947e5c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d14eed0-85d2-4b78-b994-a425f67fe5b4', 'volume_name': 'volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f036f-0b26-4bc9-968e-72fd7517b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f036f-0b26-4bc9-968e-72fd7517b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd69e212-f8bd-4c64-936e-9371be7e849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume 4d14eed0-85d2-4b78-b994-a425f67fe5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4', 'volume_size': 1} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2119499613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d14eed0-85d2-4b78-b994-a425f67fe5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c501577182a04b4eb10f7eea165905c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:08Z,use_quota=True,user_id='45ecebfc6eec4fd59cbe7f045d10933f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Creating volume 4d14eed0-85d2-4b78-b994-a425f67fe5b4 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:07 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:04:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:08 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 1073741824 Apr 30 11:04:08 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:08 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 0.915s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:08 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f Apr 30 11:04:08 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:09 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c8dfbb53-b80a-440c-a8be-2caee46da32f" returned: 0 in 0.924s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-c8dfbb53-b80a-440c-a8be-2caee46da32f" released by "delete_volume" :: held 1.924s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:09 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 1073741824" returned: 0 in 1.290s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['ba696038-4058-4143-9df7-175dcdf06935', '8f16c9fc-b855-4976-94c0-3816a79d391b', '884d4e5c-f32e-426c-9461-a6ce5ebff012', '73087e35-c14d-44b2-b694-63d04395bc96'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:09 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 Apr 30 11:04:09 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:09 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:09 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:10 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (188b28e3-018c-4b03-bf5a-7e017cbb1e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:10 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da2b205-7c33-479a-a0b0-52ce78e3c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.112s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4" returned: 0 in 1.184s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Deleted volume successfully. Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da2b205-7c33-479a-a0b0-52ce78e3c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-822653384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd5a20-e8e3-4d09-be02-b07665f6ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:10Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706f9056-ebb5-4425-8950-d22e94183152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706f9056-ebb5-4425-8950-d22e94183152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0fe8f8-06a3-4466-a4a7-5279ab2554f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0fe8f8-06a3-4466-a4a7-5279ab2554f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38dd5a20-e8e3-4d09-be02-b07665f6ed21', 'volume_name': 'volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24340d3f-b204-47ae-a4fb-5cbf1ca6a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24340d3f-b204-47ae-a4fb-5cbf1ca6a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643a090a-c234-4772-8902-0682b8f3ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Volume 38dd5a20-e8e3-4d09-be02-b07665f6ed21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21', 'volume_size': 1} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-822653384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd5a20-e8e3-4d09-be02-b07665f6ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:10Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Creating volume 38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:10 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:10 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 1073741824 Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd69e212-f8bd-4c64-936e-9371be7e849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9049498f-30b2-428e-b89d-61d6adb59fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ad154be4-943f-4b9c-a902-30558f1f27f5 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-c8dfbb53-b80a-440c-a8be-2caee46da32f-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Volume volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 (4d14eed0-85d2-4b78-b994-a425f67fe5b4): created successfully Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9049498f-30b2-428e-b89d-61d6adb59fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Flow 'volume_create_manager' (84948d7c-0a15-4f11-b543-4c5ac2dc39a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c4a908a5-d545-40bc-b7ea-d77e61fb4df1 tempest-AttachVolumeShelveTestJSON-1896847819 None] Created volume successfully. Apr 30 11:04:11 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 1073741824" returned: 0 in 1.134s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:11 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:11 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:12 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 0.795s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643a090a-c234-4772-8902-0682b8f3ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79029d22-7ab1-4035-9b8e-54a9e5cb5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:12 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Volume volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 (38dd5a20-e8e3-4d09-be02-b07665f6ed21): created successfully Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79029d22-7ab1-4035-9b8e-54a9e5cb5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (188b28e3-018c-4b03-bf5a-7e017cbb1e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3b512278-e66e-403e-8f08-bda45d536e3d tempest-VolumesSnapshotTestJSON-1758433644 None] Created volume successfully. Apr 30 11:04:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Creating offline snapshot 04cf3f35-0ba7-4399-a799-a17a8099d751 of volume 38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:04:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f8a64-5042-4f3a-9bbd-766f14745dc9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Acquiring lock "cinder-85f86cec-fbd2-4d1a-a62c-17e822faf48e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "cinder-85f86cec-fbd2-4d1a-a62c-17e822faf48e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Acquiring lock "cinder-quobyte-85f86cec-fbd2-4d1a-a62c-17e822faf48e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "cinder-quobyte-85f86cec-fbd2-4d1a-a62c-17e822faf48e" acquired by "delete_volume" :: waited 0.080s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:14 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:14 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5474de-0984-41e3-854f-ab3ada23ea77]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:14 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e Apr 30 11:04:14 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:15 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 1.149s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:15 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 1G Apr 30 11:04:15 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:15 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e" returned: 0 in 0.982s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:15 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e Apr 30 11:04:15 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:15 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-85f86cec-fbd2-4d1a-a62c-17e822faf48e" returned: 0 in 0.677s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "cinder-quobyte-85f86cec-fbd2-4d1a-a62c-17e822faf48e" released by "delete_volume" :: held 1.749s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Created reservations ['d2426303-0957-4365-8be1-0c9ce3f0afe8', '909b6290-f91c-414e-8fbb-7a3b0bac9da9', '693291e6-09d5-41dc-9ad4-16ed224477ae', '6790e417-2265-47a8-a720-93cf835e51e2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:16 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 1G" returned: 0 in 0.917s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:16 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:16 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:16 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:16 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:16 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.727s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:16 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Deleted volume successfully. Apr 30 11:04:16 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 0.862s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:16 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 is being set with open permissions: ugo+rw Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:16 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:16 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1092fe83-023e-4409-a044-c2e0f2dc9a0d tempest-VolumesNegativeTest-561688631 None] Lock "cinder-85f86cec-fbd2-4d1a-a62c-17e822faf48e-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:17 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 0.720s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:17 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info Apr 30 11:04:17 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:18 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:18 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info is being set with open permissions: ugo+rw Apr 30 11:04:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:18 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info Apr 30 11:04:18 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:19 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.info" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:19 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-934f3e0f-9d97-43a9-8879-c796826f4824 tempest-VolumesSnapshotTestJSON-1758433644 None] Create snapshot completed successfully Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Flow 'volume_create_manager' (1fc7247e-321d-40da-a98f-cd0702c95e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c87ff48-e4e1-4cfc-97e9-815e34db1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c87ff48-e4e1-4cfc-97e9-815e34db1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1616890559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967fc0b2-6f93-4364-9c80-f45f6d86701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924509b0c0a64b8fbd749c031fd54eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:19Z,use_quota=True,user_id='e4056967e4fa4b8c9ac0da3a4428497b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2203b2a-2085-4160-be71-68ad9764176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2203b2a-2085-4160-be71-68ad9764176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc7ba64-eb00-4adc-af6f-d54259c3fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc7ba64-eb00-4adc-af6f-d54259c3fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967fc0b2-6f93-4364-9c80-f45f6d86701b', 'volume_name': 'volume-967fc0b2-6f93-4364-9c80-f45f6d86701b', 'volume_size': 2}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7ffca3-e2f8-4da9-af52-4b1a6d04f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7ffca3-e2f8-4da9-af52-4b1a6d04f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba42c2b-61c0-4f75-b53b-dbaa6d3dd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Volume 967fc0b2-6f93-4364-9c80-f45f6d86701b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967fc0b2-6f93-4364-9c80-f45f6d86701b', 'volume_size': 2} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1616890559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967fc0b2-6f93-4364-9c80-f45f6d86701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924509b0c0a64b8fbd749c031fd54eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:19Z,use_quota=True,user_id='e4056967e4fa4b8c9ac0da3a4428497b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Creating volume 967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:19 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:04:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b 2147483648 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:19 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b 2147483648 Apr 30 11:04:19 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:20 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b 2147483648" returned: 0 in 1.043s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:20 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b Apr 30 11:04:20 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (6e77dfb0-ede8-4a43-955e-284b2dc570f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a286cdb-a39b-47b2-8da9-7c0d74e7e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a286cdb-a39b-47b2-8da9-7c0d74e7e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-640694545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca7129a-0dfe-455f-b065-ffa9a060841a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed27e600b43c4310b8e575a981b09711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04cf3f35-0ba7-4399-a799-a17a8099d751,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:21Z,use_quota=True,user_id='94e5b5bdb1df47cfae790ca1a3118e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a9b0c-20c0-432e-9312-70ee517e6891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a9b0c-20c0-432e-9312-70ee517e6891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20a47fb-5498-46ef-a4e3-ecb59b9095d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20a47fb-5498-46ef-a4e3-ecb59b9095d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fca7129a-0dfe-455f-b065-ffa9a060841a', 'volume_name': 'volume-fca7129a-0dfe-455f-b065-ffa9a060841a', 'volume_size': 1, 'snapshot_id': '04cf3f35-0ba7-4399-a799-a17a8099d751'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3358e4f6-9938-45ce-a98b-323e467bb060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3358e4f6-9938-45ce-a98b-323e467bb060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec01ec0-4f93-4786-87d4-d17ac5833e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Volume fca7129a-0dfe-455f-b065-ffa9a060841a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fca7129a-0dfe-455f-b065-ffa9a060841a', 'volume_size': 1, 'snapshot_id': '04cf3f35-0ba7-4399-a799-a17a8099d751'} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:21 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.274s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751-fca7129a-0dfe-455f-b065-ffa9a060841a" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba42c2b-61c0-4f75-b53b-dbaa6d3dd869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967fc0b2-6f93-4364-9c80-f45f6d86701b', 'volume_size': 2}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21969960-6e3c-47e3-bdd4-1202512523cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751-fca7129a-0dfe-455f-b065-ffa9a060841a" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Creating volume fca7129a-0dfe-455f-b065-ffa9a060841a from snapshot 04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Volume volume-967fc0b2-6f93-4364-9c80-f45f6d86701b (967fc0b2-6f93-4364-9c80-f45f6d86701b): created successfully Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21969960-6e3c-47e3-bdd4-1202512523cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Flow 'volume_create_manager' (1fc7247e-321d-40da-a98f-cd0702c95e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" acquired by "_copy_volume_from_snapshot" :: waited 0.067s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] snapshot: 04cf3f35-0ba7-4399-a799-a17a8099d751, volume: fca7129a-0dfe-455f-b065-ffa9a060841a, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:21 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-da8e1ce9-03b7-4f75-be8d-b3d39e935349 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Created volume successfully. Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[932044db-837b-4b90-ab7a-c657990bf58d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:21 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:21 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:22 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 0.915s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fa98a-5379-4818-a895-73214d3f2990]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:22 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:22 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:23 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 0.818s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:23 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:04:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:23 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a Apr 30 11:04:23 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:29 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a" returned: 0 in 5.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:29 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd0c0a-7525-4552-b026-e7803d591e8b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:29 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-1de9841c-cc87-41c8-aff1-d3f7e09587f0 req-30f9e951-8ebd-4616-8737-629c1de4aeb6 tempest-AttachVolumeShelveTestJSON-1896847819 None] No connector for attachment c4af873c-bf66-48d4-b0c8-eb9c61561ddf; skipping storage backend terminate_connection call. {{(pid=84432) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Apr 30 11:04:29 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-1de9841c-cc87-41c8-aff1-d3f7e09587f0 req-30f9e951-8ebd-4616-8737-629c1de4aeb6 tempest-AttachVolumeShelveTestJSON-1896847819 None] Deleting attachment c4af873c-bf66-48d4-b0c8-eb9c61561ddf. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:04:29 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:29 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:30 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 1.478s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:30 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:04:30 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Converted 1024.00 MB image at 175.55 MB/s Apr 30 11:04:30 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a is being set with open permissions: ugo+rw Apr 30 11:04:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:30 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a Apr 30 11:04:30 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:31 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a" returned: 0 in 0.817s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" released by "_copy_volume_from_snapshot" :: held 10.033s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751-fca7129a-0dfe-455f-b065-ffa9a060841a" released by "_create_volume_from_snapshot" :: held 10.130s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.182s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.548s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Creating offline snapshot dfd37661-9186-4084-8481-68bc53a5706c of volume 967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec01ec0-4f93-4786-87d4-d17ac5833e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca7129a-0dfe-455f-b065-ffa9a060841a', 'volume_size': 1, 'snapshot_id': '04cf3f35-0ba7-4399-a799-a17a8099d751'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8ec86d-ddf2-4b62-bfd3-789b0eeb4b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad2fc55-df5c-4d6c-b81a-f6c5d2dbf038]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Volume volume-fca7129a-0dfe-455f-b065-ffa9a060841a (fca7129a-0dfe-455f-b065-ffa9a060841a): created successfully Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8ec86d-ddf2-4b62-bfd3-789b0eeb4b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Flow 'volume_create_manager' (6e77dfb0-ede8-4a43-955e-284b2dc570f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d5039df5-b699-4614-bfcd-b1853f8d3fde tempest-VolumesSnapshotTestJSON-1758433644 None] Created volume successfully. Apr 30 11:04:31 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b Apr 30 11:04:31 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-fca7129a-0dfe-455f-b065-ffa9a060841a-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-fca7129a-0dfe-455f-b065-ffa9a060841a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408aa76-1dd4-47fb-8d89-32a8270e17a8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:32 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a Apr 30 11:04:32 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:32 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b" returned: 0 in 1.010s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c 2G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:32 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c 2G Apr 30 11:04:32 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:33 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a" returned: 0 in 0.784s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:33 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a Apr 30 11:04:33 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (1d8f8a4d-aa99-4921-b44b-55363a2e32b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0f73c-dd49-4e2e-8b27-33de4c41c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0f73c-dd49-4e2e-8b27-33de4c41c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2092246042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9b1a61-5e55-4763-baf0-fbe08d6a3bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:34Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a01d719-deff-46e2-8317-b21c3916fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a01d719-deff-46e2-8317-b21c3916fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad844449-5145-432b-8bea-2d23d1a9153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad844449-5145-432b-8bea-2d23d1a9153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9b1a61-5e55-4763-baf0-fbe08d6a3bba', 'volume_name': 'volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb18d1cc-a76a-46e2-87bb-e590316a2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb18d1cc-a76a-46e2-87bb-e590316a2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcd9f33-4a4f-4803-8ba1-7d4d2352291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Volume 2f9b1a61-5e55-4763-baf0-fbe08d6a3bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba', 'volume_size': 1} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:33 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c 2G" returned: 0 in 1.307s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967fc0b2-6f93-4364-9c80-f45f6d86701b -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:33 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967fc0b2-6f93-4364-9c80-f45f6d86701b -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c Apr 30 11:04:33 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:34 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fca7129a-0dfe-455f-b065-ffa9a060841a" returned: 0 in 0.977s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-fca7129a-0dfe-455f-b065-ffa9a060841a" released by "delete_volume" :: held 1.814s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['ca3cd604-98b7-4dde-be32-2d23767c510c', '63c28ebe-4763-49c7-92fd-69572fea5425', '706b225d-259d-4473-ae05-c5a110a3ce36', '6fd9a3cd-9e44-4949-8373-a11fa0ab9fdf'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:34 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:34 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:34 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967fc0b2-6f93-4364-9c80-f45f6d86701b -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c" returned: 0 in 0.744s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:34 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c is being set with open permissions: ugo+rw Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:34 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-04cf3f35-0ba7-4399-a799-a17a8099d751-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:34 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-04cf3f35-0ba7-4399-a799-a17a8099d751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Deleting offline snapshot 04cf3f35-0ba7-4399-a799-a17a8099d751 of volume 38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] snapshot_file for this snap is: volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c2474e-0469-4157-bb2c-f49c40a17a46]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:35 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:35 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:35 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.837s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Deleted volume successfully. Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f71687d8-d404-440d-bab3-1d417e38328e tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-fca7129a-0dfe-455f-b065-ffa9a060841a-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:35 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:35 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info Apr 30 11:04:35 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:35 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 0.901s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cede4ece-566d-4ec1-b733-a9ed7baba998]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:35 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:35 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:36 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info" returned: 0 in 0.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:36 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info is being set with open permissions: ugo+rw Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:36 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info Apr 30 11:04:36 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:36 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 0.795s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:36 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:36 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:36 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.info" returned: 0 in 0.702s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.429s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2092246042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9b1a61-5e55-4763-baf0-fbe08d6a3bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:34Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Creating volume 2f9b1a61-5e55-4763-baf0-fbe08d6a3bba {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:36 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:04:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:36 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba 1073741824 Apr 30 11:04:36 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-506b66ab-2516-452c-aca6-c872689bc6be tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Create snapshot completed successfully Apr 30 11:04:37 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 0.805s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:37 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751 Apr 30 11:04:37 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:38 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba 1073741824" returned: 0 in 1.183s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:38 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba Apr 30 11:04:38 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "cinder-dfd37661-9186-4084-8481-68bc53a5706c-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-dfd37661-9186-4084-8481-68bc53a5706c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "cinder-quobyte-dfd37661-9186-4084-8481-68bc53a5706c" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-dfd37661-9186-4084-8481-68bc53a5706c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Deleting offline snapshot dfd37661-9186-4084-8481-68bc53a5706c of volume 967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] snapshot_file for this snap is: volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3e92ab-802a-497d-ab97-3236b373f8a8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:38 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c Apr 30 11:04:38 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:38 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21.04cf3f35-0ba7-4399-a799-a17a8099d751" returned: 0 in 1.207s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-04cf3f35-0ba7-4399-a799-a17a8099d751" released by "_delete_snapshot" :: held 3.884s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" released by "delete_snapshot" :: held 3.927s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:38 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['28e9c253-9f0d-406b-a4c4-428f6976df64', '857854ff-6b51-482f-a1ed-9626150c4f60', '3189927b-3da5-4a5b-aa19-f4e04d8d8db2', '507a1ab6-e0b5-40a6-a31e-da8f2f65874c'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Delete snapshot completed successfully. Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dbf1da23-9eb3-49e1-90f2-ee2e21b33e21 tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-04cf3f35-0ba7-4399-a799-a17a8099d751-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:39 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" returned: 0 in 1.026s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcd9f33-4a4f-4803-8ba1-7d4d2352291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3494670e-8c92-49f1-80bc-c5445bf92dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-38dd5a20-e8e3-4d09-be02-b07665f6ed21-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:39 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Volume volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba (2f9b1a61-5e55-4763-baf0-fbe08d6a3bba): created successfully Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3494670e-8c92-49f1-80bc-c5445bf92dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (1d8f8a4d-aa99-4921-b44b-55363a2e32b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-38dd5a20-e8e3-4d09-be02-b07665f6ed21-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4acc543e-9bd6-46fa-b9be-bf76d0ca81b2 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" acquired by "delete_volume" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc5a2df-8e36-47eb-9d48-7238164b40c5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:39 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:39 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:39 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c" returned: 0 in 1.302s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967fc0b2-6f93-4364-9c80-f45f6d86701b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c775f1-38d1-45b0-9ffd-722d81dbc842]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:39 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b Apr 30 11:04:39 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b75e6de8-fad5-44ef-a30f-0e7330400492 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" by "attach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:40 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 0.830s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b75e6de8-fad5-44ef-a30f-0e7330400492 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" acquired by "attach_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:40 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21 Apr 30 11:04:40 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b75e6de8-fad5-44ef-a30f-0e7330400492 tempest-VolumesActionsTest-1133554016 None] Attaching volume 2f9b1a61-5e55-4763-baf0-fbe08d6a3bba to instance 09fb3855-2c04-49b4-ada3-55185895d8fb at mountpoint /dev/vdb on host None. Apr 30 11:04:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b75e6de8-fad5-44ef-a30f-0e7330400492 tempest-VolumesActionsTest-1133554016 None] Attach volume completed successfully. Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b75e6de8-fad5-44ef-a30f-0e7330400492 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" released by "attach_volume" :: held 0.182s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:40 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b" returned: 0 in 0.871s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:40 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c Apr 30 11:04:40 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:41 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-38dd5a20-e8e3-4d09-be02-b07665f6ed21" returned: 0 in 0.840s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-38dd5a20-e8e3-4d09-be02-b07665f6ed21" released by "delete_volume" :: held 1.767s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['c8e37d12-568e-4b0c-a58c-a1acf4eaa986', '72c93492-894f-449e-8384-a0c5b7a7064d', 'f1c714cb-03b6-4d3b-a7c2-c10fd360f418', 'd1ef6b3f-6877-4723-b397-89b0d9185719'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:41 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:41 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Terminate volume connection completed successfully. Apr 30 11:04:41 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-7903a5e3-075f-43dd-bc87-bc64174d7eb3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-7903a5e3-075f-43dd-bc87-bc64174d7eb3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:42 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c" returned: 0 in 1.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16f2bd-33a0-4d8d-874a-bc49d52f9727]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:42 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c Apr 30 11:04:42 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" by "detach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Detaching volume 2f9b1a61-5e55-4763-baf0-fbe08d6a3bba from instance 09fb3855-2c04-49b4-ada3-55185895d8fb. Apr 30 11:04:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Detach volume completed successfully. Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d71fd3d0-f789-41ea-ac8f-73d6a87c41f5 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:42 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 Apr 30 11:04:42 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:42 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.336s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Deleted volume successfully. Apr 30 11:04:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8943942d-674e-4ad8-8a30-4bcba758388d tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-38dd5a20-e8e3-4d09-be02-b07665f6ed21-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3c1c7431-4f05-4ed0-b620-625302f8d9cf tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" by "detach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3c1c7431-4f05-4ed0-b620-625302f8d9cf tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3c1c7431-4f05-4ed0-b620-625302f8d9cf tempest-VolumesActionsTest-1133554016 None] Volume detach called, but volume not attached. Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3c1c7431-4f05-4ed0-b620-625302f8d9cf tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:43 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b.dfd37661-9186-4084-8481-68bc53a5706c" returned: 0 in 1.141s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-dfd37661-9186-4084-8481-68bc53a5706c" released by "_delete_snapshot" :: held 5.125s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" released by "delete_snapshot" :: held 5.165s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Created reservations ['6fd35b0f-8ab2-422d-a870-92f6475d2da8', '7a5a7acb-38ec-4f73-b658-986e5884f823', '0d5ae1d4-1aac-425c-bf83-d15c9e65f0ec', '15d246b1-1c95-49e5-8fb2-2963b6ba75c5'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Delete snapshot completed successfully. Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4d4044d6-06c1-466b-baa6-71410daf5f3b tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-dfd37661-9186-4084-8481-68bc53a5706c-delete_snapshot" released by "delete_snapshot" :: held 5.385s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:43 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3" returned: 0 in 1.487s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:43 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3 Apr 30 11:04:43 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "cinder-967fc0b2-6f93-4364-9c80-f45f6d86701b-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-967fc0b2-6f93-4364-9c80-f45f6d86701b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-quobyte-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" acquired by "delete_volume" :: waited 0.042s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-quobyte-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" acquired by "delete_volume" :: waited 0.056s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[547db599-6567-4c4e-a141-0b484e8fa002]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e59bae-6090-4641-ab05-c779d491a046]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:44 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b Apr 30 11:04:44 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:44 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba Apr 30 11:04:44 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:44 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7903a5e3-075f-43dd-bc87-bc64174d7eb3" returned: 0 in 0.814s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-quobyte-7903a5e3-075f-43dd-bc87-bc64174d7eb3" released by "delete_volume" :: held 2.447s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Created reservations ['034d822c-6e24-4658-8662-231279baee17', 'd003be67-a306-4ba7-a45f-6cf345882f3d', '161e2ee2-eb42-4a0f-b244-0d81f6a23bfa', '8685d85a-289b-44f9-bebb-28e10bab1a5e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:44 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:44 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:45 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:45 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b Apr 30 11:04:45 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:45 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" returned: 0 in 0.880s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:45 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba Apr 30 11:04:45 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:45 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.811s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Deleted volume successfully. Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4386eae-701e-49b3-9552-73eca830532f tempest-VolumesSnapshotTestJSON-1758433644 None] Lock "cinder-7903a5e3-075f-43dd-bc87-bc64174d7eb3-delete_volume" released by "delete_volume" :: held 3.618s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:45 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-967fc0b2-6f93-4364-9c80-f45f6d86701b" returned: 0 in 0.790s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-quobyte-967fc0b2-6f93-4364-9c80-f45f6d86701b" released by "delete_volume" :: held 1.705s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:45 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Created reservations ['d93441c9-925a-4ac3-bb73-996c2b3a0c9d', '21e950b1-0da2-48da-8379-8402d0e14ebf', '07c73c14-0645-4ffa-a106-51136605dad7', 'ba3d5fe7-f086-43ce-afbf-9f1a35546cdb'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:46 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" returned: 0 in 0.893s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-quobyte-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba" released by "delete_volume" :: held 1.850s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:46 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:46 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Created reservations ['2dd4a500-6818-496e-a4c3-ce074eb554f7', 'c080f322-ebd8-4b9f-8549-1f8bd6095265', 'd971e981-3687-4a18-9502-6a3b92884da3', '85a99c27-7cdb-4903-ac08-868797d48991'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:46 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:04:46 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:47 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.115s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Deleted volume successfully. Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2fe98afc-6ba5-4e13-b55b-31fbeec16b11 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-2f9b1a61-5e55-4763-baf0-fbe08d6a3bba-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:47 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.387s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:04:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Deleted volume successfully. Apr 30 11:04:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e0b2cc3b-5f2e-479f-a604-dbfba583af93 tempest-VolumesSnapshotNegativeTestJSON-954789988 None] Lock "cinder-967fc0b2-6f93-4364-9c80-f45f6d86701b-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=81,cinder:UPDATE=107,cinder:INSERT=28,cinder:DELETE=9 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=100,cinder:DELETE=7,cinder:SELECT=87,cinder:INSERT=24 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (84cc05a8-7dfd-479b-b665-5dd44d112e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf68f36-786f-49f5-952d-b05cda65c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf68f36-786f-49f5-952d-b05cda65c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-112783589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a3c775-4b49-4961-9abe-e8e96cd4c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:56Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1c4fdc-c840-40a8-a1d0-6b82c0d79619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1c4fdc-c840-40a8-a1d0-6b82c0d79619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eef16e-45b9-4670-a11f-08a0a8e76ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eef16e-45b9-4670-a11f-08a0a8e76ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a3c775-4b49-4961-9abe-e8e96cd4c65c', 'volume_name': 'volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c5bb69-3509-42d1-a4c4-219a68c19adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c5bb69-3509-42d1-a4c4-219a68c19adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9c67b0-502f-414e-8d7f-b33ee252d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:55 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Volume e3a3c775-4b49-4961-9abe-e8e96cd4c65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c', 'volume_size': 1} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-112783589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a3c775-4b49-4961-9abe-e8e96cd4c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:56Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Creating volume e3a3c775-4b49-4961-9abe-e8e96cd4c65c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:55 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:04:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:55 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c 1073741824 Apr 30 11:04:55 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:57 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c 1073741824" returned: 0 in 1.152s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:57 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c Apr 30 11:04:57 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:57 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" returned: 0 in 0.840s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9c67b0-502f-414e-8d7f-b33ee252d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bb28c3-2201-417e-9728-eec10727e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Volume volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c (e3a3c775-4b49-4961-9abe-e8e96cd4c65c): created successfully Apr 30 11:04:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bb28c3-2201-417e-9728-eec10727e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (84cc05a8-7dfd-479b-b665-5dd44d112e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:58 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7ec6d0af-39f3-40a1-9f94-09bd04c78f31 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-e3a3c775-4b49-4961-9abe-e8e96cd4c65c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "cinder-e3a3c775-4b49-4961-9abe-e8e96cd4c65c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-quobyte-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5689ef4-a047-402c-9e17-a98decaadd83]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:59 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c Apr 30 11:04:59 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:00 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" returned: 0 in 0.988s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:00 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c Apr 30 11:05:00 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:01 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" returned: 0 in 0.849s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-e3a3c775-4b49-4961-9abe-e8e96cd4c65c" released by "delete_volume" :: held 1.897s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Created reservations ['990cf48b-175a-4327-8630-2f67c726b14c', 'f27de5fa-5d65-4031-b791-66c4be65d18b', '857616d7-0d36-4470-b728-f5601f8f7f90', '8ee29125-0173-47b9-b46a-6b68a07e15b8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:01 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:01 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:02 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.223s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Deleted volume successfully. Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89b0310c-50c0-4381-9edf-a5f9651c054c tempest-VolumesActionsTest-1636598948 None] Lock "cinder-e3a3c775-4b49-4961-9abe-e8e96cd4c65c-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (c1263868-05aa-4bf6-a773-45addc53a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69de898e-cb2e-4f67-b15b-cc3cafb172a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69de898e-cb2e-4f67-b15b-cc3cafb172a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843688998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437aec77-326f-4a86-a2e0-7115669a8878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:03Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327e4fd8-54cc-4b36-a26b-ee037715f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327e4fd8-54cc-4b36-a26b-ee037715f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b02cab-fcd1-4ff3-9881-6c9036bde967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b02cab-fcd1-4ff3-9881-6c9036bde967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437aec77-326f-4a86-a2e0-7115669a8878', 'volume_name': 'volume-437aec77-326f-4a86-a2e0-7115669a8878', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70950f0e-4e39-43d0-a6ce-9f840a9d1bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70950f0e-4e39-43d0-a6ce-9f840a9d1bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbafd00-85bc-4e0a-a5ba-b8627d4ec11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Volume 437aec77-326f-4a86-a2e0-7115669a8878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437aec77-326f-4a86-a2e0-7115669a8878', 'volume_size': 1} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843688998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437aec77-326f-4a86-a2e0-7115669a8878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:03Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Creating volume 437aec77-326f-4a86-a2e0-7115669a8878 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:02 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:02 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 1073741824 Apr 30 11:05:02 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:03 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 1073741824" returned: 0 in 1.088s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:03 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 Apr 30 11:05:03 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:04 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbafd00-85bc-4e0a-a5ba-b8627d4ec11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437aec77-326f-4a86-a2e0-7115669a8878', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fe10ef-cbe8-42e2-bd7f-fda07c20f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Volume volume-437aec77-326f-4a86-a2e0-7115669a8878 (437aec77-326f-4a86-a2e0-7115669a8878): created successfully Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fe10ef-cbe8-42e2-bd7f-fda07c20f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (c1263868-05aa-4bf6-a773-45addc53a53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7d1b4423-5aea-42bc-94b2-236ab5a8b524 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-437aec77-326f-4a86-a2e0-7115669a8878-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:06 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-437aec77-326f-4a86-a2e0-7115669a8878-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:06 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-quobyte-437aec77-326f-4a86-a2e0-7115669a8878" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-437aec77-326f-4a86-a2e0-7115669a8878" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a3ee46-0978-4a41-a068-1606bad12046]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:06 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 Apr 30 11:05:06 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:06 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.825s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:07 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878" returned: 0 in 0.929s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:07 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878 Apr 30 11:05:07 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:07 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-437aec77-326f-4a86-a2e0-7115669a8878" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-437aec77-326f-4a86-a2e0-7115669a8878" released by "delete_volume" :: held 1.660s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Created reservations ['ce2c88cc-368e-4155-be4f-d902bfff9bb3', '413440a0-781d-413c-90d6-d01a02feec41', '98778697-dad1-4911-84c2-cfbbf750f299', 'ce1840bd-8a45-4d7a-9bbc-54683ba7e690'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:08 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:08 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:08 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.745s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Deleted volume successfully. Apr 30 11:05:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8a153b03-a9d8-486c-b7e3-1d116bbfff61 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-437aec77-326f-4a86-a2e0-7115669a8878-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (623be908-3715-42fd-8204-bb4913da6a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec47405-aca6-4cc2-8dd2-1cdd8109179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec47405-aca6-4cc2-8dd2-1cdd8109179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961917552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7dab5c8-a71d-4cd0-b2da-928e1ec6f001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:09Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bb01f5-2518-4088-aecc-7a9f82a0a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bb01f5-2518-4088-aecc-7a9f82a0a15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe6f70a-589e-4a07-a822-2bad03c141b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe6f70a-589e-4a07-a822-2bad03c141b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7dab5c8-a71d-4cd0-b2da-928e1ec6f001', 'volume_name': 'volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc353a50-a9e3-4967-af87-27dd9f718e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc353a50-a9e3-4967-af87-27dd9f718e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc6314-48f2-491f-bcda-690afe45f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:09 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Volume d7dab5c8-a71d-4cd0-b2da-928e1ec6f001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001', 'volume_size': 1} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961917552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7dab5c8-a71d-4cd0-b2da-928e1ec6f001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:09Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Creating volume d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:09 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:09 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 1073741824 Apr 30 11:05:09 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:10 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 1073741824" returned: 0 in 1.016s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:10 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 Apr 30 11:05:10 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:11 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc6314-48f2-491f-bcda-690afe45f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4a6e41-9961-4c8d-8c51-e62d9f7182a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:11 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Volume volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 (d7dab5c8-a71d-4cd0-b2da-928e1ec6f001): created successfully Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4a6e41-9961-4c8d-8c51-e62d9f7182a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (623be908-3715-42fd-8204-bb4913da6a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a6172dbe-012a-4b74-b3a5-95416edadcd4 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-quobyte-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca64f5-450b-4769-8b44-7b2291140159]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:12 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 Apr 30 11:05:12 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:13 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" returned: 0 in 0.869s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:13 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001 Apr 30 11:05:13 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:14 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001" released by "delete_volume" :: held 1.589s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Created reservations ['08938059-9553-4a49-9504-874cae030bb1', '6df7716f-a706-4e45-a040-4943d1abef9b', '8c201d89-48c1-4eef-a8d3-15c69bf7e1f1', 'e6b7623f-187d-412b-aa44-2f378518b588'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:14 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:14 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:15 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.921s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Deleted volume successfully. Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-df3ad1d3-e573-4299-a72b-824b5dd781d0 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-d7dab5c8-a71d-4cd0-b2da-928e1ec6f001-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (569373d4-5b9c-4dde-86ef-6d45cf98f0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dde7fcc-d3ae-4b55-bc1c-7199aa3da115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dde7fcc-d3ae-4b55-bc1c-7199aa3da115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-717950803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a064143-cdb2-40c4-9313-af3bd0fcdd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:16Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4df8e9-2c99-488d-955f-4477bb1d904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4df8e9-2c99-488d-955f-4477bb1d904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0856c6-351d-4c66-9e40-7e76d15500e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0856c6-351d-4c66-9e40-7e76d15500e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a064143-cdb2-40c4-9313-af3bd0fcdd45', 'volume_name': 'volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ef7a5-1322-48e6-b088-c55cd07ad860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ef7a5-1322-48e6-b088-c55cd07ad860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba423cce-85ed-4f8c-9af0-380b80240183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Volume 2a064143-cdb2-40c4-9313-af3bd0fcdd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45', 'volume_size': 1} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-717950803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a064143-cdb2-40c4-9313-af3bd0fcdd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:16Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Creating volume 2a064143-cdb2-40c4-9313-af3bd0fcdd45 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:15 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:15 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 1073741824 Apr 30 11:05:15 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:16 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 1073741824" returned: 0 in 0.959s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:16 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 Apr 30 11:05:16 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:17 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45" returned: 0 in 0.767s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba423cce-85ed-4f8c-9af0-380b80240183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6699e75d-1486-4384-9c70-ed79008e4db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:17 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Volume volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 (2a064143-cdb2-40c4-9313-af3bd0fcdd45): created successfully Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6699e75d-1486-4384-9c70-ed79008e4db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (569373d4-5b9c-4dde-86ef-6d45cf98f0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0cefd25b-99d2-4418-accb-093c56413ad2 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-2a064143-cdb2-40c4-9313-af3bd0fcdd45-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-2a064143-cdb2-40c4-9313-af3bd0fcdd45-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "cinder-quobyte-2a064143-cdb2-40c4-9313-af3bd0fcdd45" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-2a064143-cdb2-40c4-9313-af3bd0fcdd45" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3117d4-2fe6-4410-938a-89635375bb95]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:19 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 Apr 30 11:05:19 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:20 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45" returned: 0 in 1.025s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:20 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45 Apr 30 11:05:20 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Flow 'volume_create_manager' (1c82f3d8-4a74-4645-823d-bc404798f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be809d0c-87d5-4672-85db-0ecb50b5e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be809d0c-87d5-4672-85db-0ecb50b5e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-361286786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd23dfb-df2d-4360-9ca7-36686a349f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c6bb68d8e14cde995de1b1f713b134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:21Z,use_quota=True,user_id='2cc9ebb6ad814d7eaf075e22858a3e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a148508a-a92c-425c-a9dd-d8c826b0f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a148508a-a92c-425c-a9dd-d8c826b0f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3064a2-5cca-4dfe-8408-d857efd0e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3064a2-5cca-4dfe-8408-d857efd0e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd23dfb-df2d-4360-9ca7-36686a349f62', 'volume_name': 'volume-ebd23dfb-df2d-4360-9ca7-36686a349f62', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4714b53b-2236-4707-9396-85a2226b6c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4714b53b-2236-4707-9396-85a2226b6c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2739933-8e91-4197-8133-8d0f889a1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:20 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Volume ebd23dfb-df2d-4360-9ca7-36686a349f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd23dfb-df2d-4360-9ca7-36686a349f62', 'volume_size': 1} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-361286786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd23dfb-df2d-4360-9ca7-36686a349f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c6bb68d8e14cde995de1b1f713b134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:21Z,use_quota=True,user_id='2cc9ebb6ad814d7eaf075e22858a3e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Creating volume ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:20 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:20 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 1073741824 Apr 30 11:05:20 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:21 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2a064143-cdb2-40c4-9313-af3bd0fcdd45" returned: 0 in 0.849s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-quobyte-2a064143-cdb2-40c4-9313-af3bd0fcdd45" released by "delete_volume" :: held 1.971s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Created reservations ['aee88ac6-2b07-46fb-bbcb-7885984e3f44', '36059b67-9102-430c-b850-3c180357e7dd', '0d4e0648-a117-405b-b961-852ca87da817', 'd7fd7cd4-60ff-46cc-a7f4-4bfcc4afae69'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:21 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:21 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:22 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:22 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 1073741824" returned: 0 in 1.331s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.939s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:22 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Deleted volume successfully. Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (8a8259e6-ad2c-44ec-bb7c-8a9f788f0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cf9a62-8b00-456f-81b7-8e14cfb211e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cf9a62-8b00-456f-81b7-8e14cfb211e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568464881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecebaae-a7b3-40e2-b6aa-c334e3ff836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:22Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec66cb0-32e6-4d9f-be82-cbfc547ca12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec66cb0-32e6-4d9f-be82-cbfc547ca12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a47a8-8ec0-4669-8641-04571de85f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a47a8-8ec0-4669-8641-04571de85f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fecebaae-a7b3-40e2-b6aa-c334e3ff836c', 'volume_name': 'volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df44e3f5-7bb3-40a6-98bb-d3d297a115fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df44e3f5-7bb3-40a6-98bb-d3d297a115fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bdd82f-88e7-4c8a-9a0b-0e383b15f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:22 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Volume fecebaae-a7b3-40e2-b6aa-c334e3ff836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c', 'volume_size': 1} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-dda2f5e8-769b-4b16-b985-94e826cd38d1 tempest-VolumesActionsTest-1636598948 None] Lock "cinder-2a064143-cdb2-40c4-9313-af3bd0fcdd45-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:22 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:22 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:23 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 0.830s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568464881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecebaae-a7b3-40e2-b6aa-c334e3ff836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe5987f80e04bb1988808b74ca51295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:22Z,use_quota=True,user_id='af94c3765a1949528581f5e4ecd2e834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Creating volume fecebaae-a7b3-40e2-b6aa-c334e3ff836c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:23 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:23 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c 1073741824 Apr 30 11:05:23 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2739933-8e91-4197-8133-8d0f889a1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd23dfb-df2d-4360-9ca7-36686a349f62', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c5eb3e-0749-4501-9443-2f0ae2d23f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:23 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Volume volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 (ebd23dfb-df2d-4360-9ca7-36686a349f62): created successfully Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c5eb3e-0749-4501-9443-2f0ae2d23f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Flow 'volume_create_manager' (1c82f3d8-4a74-4645-823d-bc404798f123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7283cc52-7517-4dcf-a7a6-be3116eb2147 tempest-SnapshotDependencyTests-1186289076 None] Created volume successfully. Apr 30 11:05:24 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c 1073741824" returned: 0 in 1.139s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:24 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c Apr 30 11:05:24 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:25 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" returned: 0 in 0.757s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bdd82f-88e7-4c8a-9a0b-0e383b15f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd870fd-b581-4d5b-a3d1-ed8dd55d28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Creating offline snapshot d95b9084-2487-4f25-9849-b14f235be268 of volume ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:05:25 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Volume volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c (fecebaae-a7b3-40e2-b6aa-c334e3ff836c): created successfully Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd870fd-b581-4d5b-a3d1-ed8dd55d28ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Flow 'volume_create_manager' (8a8259e6-ad2c-44ec-bb7c-8a9f788f0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0060b21d-350b-46d3-aa0b-ed49eb500072]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3e13177e-21d2-43e4-98ec-d998ca74a4e6 tempest-VolumesActionsTest-1133554016 None] Created volume successfully. Apr 30 11:05:25 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:25 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:26 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 1.070s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-fecebaae-a7b3-40e2-b6aa-c334e3ff836c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:26 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 1G Apr 30 11:05:26 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-fecebaae-a7b3-40e2-b6aa-c334e3ff836c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "cinder-quobyte-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-quobyte-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[430bdc2d-3eca-4ec9-aae4-13d4d26eb6a9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:26 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c Apr 30 11:05:26 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:27 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" returned: 0 in 1.077s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:27 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c Apr 30 11:05:27 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:27 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 1G" returned: 0 in 1.369s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:27 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:27 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:28 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" returned: 0 in 0.818s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-quobyte-fecebaae-a7b3-40e2-b6aa-c334e3ff836c" released by "delete_volume" :: held 1.980s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Created reservations ['be4f12ac-b3c6-4201-a1b4-4f96ec56734c', '288817a9-1199-41e0-b952-ece6d3f955fb', '32bf440b-8ed2-4aa5-82f1-54b3581005ce', '4e200f44-0e69-412b-9a74-db831f766b6a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:28 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:28 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:28 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 1.016s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:28 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 is being set with open permissions: ugo+rw Apr 30 11:05:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:28 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:28 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:29 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.809s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:29 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Deleted volume successfully. Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87a02685-c09f-424e-90c5-aefdcd279b10 tempest-VolumesActionsTest-1133554016 None] Lock "cinder-fecebaae-a7b3-40e2-b6aa-c334e3ff836c-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "cinder-4d14eed0-85d2-4b78-b994-a425f67fe5b4-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-4d14eed0-85d2-4b78-b994-a425f67fe5b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:29 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 0.975s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "cinder-quobyte-4d14eed0-85d2-4b78-b994-a425f67fe5b4" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-quobyte-4d14eed0-85d2-4b78-b994-a425f67fe5b4" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:29 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info Apr 30 11:05:29 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853ac73-1563-41ac-bdd1-82e6885a9386]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:29 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 Apr 30 11:05:29 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:30 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:30 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info is being set with open permissions: ugo+rw Apr 30 11:05:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:30 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info Apr 30 11:05:30 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:30 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4" returned: 0 in 0.889s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:30 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4 Apr 30 11:05:30 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:31 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4d14eed0-85d2-4b78-b994-a425f67fe5b4" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-quobyte-4d14eed0-85d2-4b78-b994-a425f67fe5b4" released by "delete_volume" :: held 1.595s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:31 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.info" returned: 0 in 0.899s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.240s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-913400c0-58b0-4172-bfd0-ea4af8e26f9b tempest-SnapshotDependencyTests-1186289076 None] Create snapshot completed successfully Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Created reservations ['a548193a-fc08-49ce-997f-893c03ab3862', '28f82eaa-ef19-43cd-ab32-47f238248ccf', '58548df9-1a8c-412d-8c26-8797d79756b1', '54c7c00d-62a3-424c-a9f5-85750cd9769c'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:31 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:31 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "cinder-0f6f7349-a7c7-456e-8c56-2e0604add305-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-0f6f7349-a7c7-456e-8c56-2e0604add305-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "cinder-quobyte-0f6f7349-a7c7-456e-8c56-2e0604add305" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-quobyte-0f6f7349-a7c7-456e-8c56-2e0604add305" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[594be6b2-3125-487a-a386-28281e43ab8e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:32 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.939s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Deleted volume successfully. Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-33eceb2f-27f1-46b9-8b0b-368c861ebc74 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-4d14eed0-85d2-4b78-b994-a425f67fe5b4-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:32 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 Apr 30 11:05:32 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Flow 'volume_create_manager' (8548ee28-cfa6-46d9-acd6-56418fa47d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad65813-f5ee-4be1-bba5-ae2c858b2038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad65813-f5ee-4be1-bba5-ae2c858b2038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ef4167-3cab-44ba-a2b6-2d775dd2f3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c6bb68d8e14cde995de1b1f713b134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d95b9084-2487-4f25-9849-b14f235be268,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:33Z,use_quota=True,user_id='2cc9ebb6ad814d7eaf075e22858a3e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9efff7e-1d89-4711-955b-8cfb50ebe7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9efff7e-1d89-4711-955b-8cfb50ebe7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9cc00-d743-4e23-8dd6-0ef0f605ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9cc00-d743-4e23-8dd6-0ef0f605ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14ef4167-3cab-44ba-a2b6-2d775dd2f3c6', 'volume_name': 'volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6', 'volume_size': 1, 'snapshot_id': 'd95b9084-2487-4f25-9849-b14f235be268'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3aa6ce-716f-44ad-8165-b61ffd127644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3aa6ce-716f-44ad-8165-b61ffd127644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed24d54-dfe7-4df1-89ee-8ef488f5b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Volume 14ef4167-3cab-44ba-a2b6-2d775dd2f3c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6', 'volume_size': 1, 'snapshot_id': 'd95b9084-2487-4f25-9849-b14f235be268'} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Creating volume 14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 from snapshot d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] snapshot: d95b9084-2487-4f25-9849-b14f235be268, volume: 14ef4167-3cab-44ba-a2b6-2d775dd2f3c6, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5618e0d-87dd-4805-9194-c35f1959f413]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:33 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:33 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:33 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305" returned: 0 in 1.194s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:33 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305 Apr 30 11:05:33 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:34 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 0.986s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd23dfb-df2d-4360-9ca7-36686a349f62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e00dc7-4125-402f-a63c-15ca9556dc6f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:34 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:34 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:34 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0f6f7349-a7c7-456e-8c56-2e0604add305" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-quobyte-0f6f7349-a7c7-456e-8c56-2e0604add305" released by "delete_volume" :: held 2.016s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Created reservations ['594e19ee-3ea8-4992-a430-ffa7f3ccf766', '870722af-3f24-4715-9c82-f6e66946c0e7', 'b5638dcf-4702-4f21-bbe5-fb7c1ca03ea6', '681a92cd-ca84-4f4b-8707-8c865fa8cb69'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:34 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:34 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:35 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 0.904s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:35 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 Apr 30 11:05:35 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:35 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.721s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Deleted volume successfully. Apr 30 11:05:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6dfb147a-7eb6-4ec2-9e0b-984c2fdfca87 tempest-AttachVolumeShelveTestJSON-1896847819 None] Lock "cinder-0f6f7349-a7c7-456e-8c56-2e0604add305-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:41 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" returned: 0 in 6.798s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05401c3-7a33-4839-9e79-f31930c2164f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:42 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:42 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:43 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 1.247s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:43 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:05:43 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Converted 1024.00 MB image at 150.61 MB/s Apr 30 11:05:43 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 is being set with open permissions: ugo+rw Apr 30 11:05:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:43 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 Apr 30 11:05:43 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:44 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" returned: 0 in 0.906s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" released by "_copy_volume_from_snapshot" :: held 10.969s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" released by "_create_volume_from_snapshot" :: held 11.017s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.036s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed24d54-dfe7-4df1-89ee-8ef488f5b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6', 'volume_size': 1, 'snapshot_id': 'd95b9084-2487-4f25-9849-b14f235be268'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb4e32a-9e79-4b31-bfaa-e0b549abcead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Volume volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 (14ef4167-3cab-44ba-a2b6-2d775dd2f3c6): created successfully Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb4e32a-9e79-4b31-bfaa-e0b549abcead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Flow 'volume_create_manager' (8548ee28-cfa6-46d9-acd6-56418fa47d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-007d63d3-c7c1-49f6-b67a-66ca3afd1925 tempest-SnapshotDependencyTests-1186289076 None] Created volume successfully. Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-d95b9084-2487-4f25-9849-b14f235be268-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-d95b9084-2487-4f25-9849-b14f235be268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Deleting offline snapshot d95b9084-2487-4f25-9849-b14f235be268 of volume ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] snapshot_file for this snap is: volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[75abe27b-dd97-44cc-9650-0d59b66bb7e3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:45 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:45 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:46 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 0.876s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd23dfb-df2d-4360-9ca7-36686a349f62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:05:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b092548-bda3-4e60-9682-1a49ff405b7f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:46 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:46 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:47 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 0.870s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:47 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:47 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:48 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 0.907s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:48 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268 Apr 30 11:05:48 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:48 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62.d95b9084-2487-4f25-9849-b14f235be268" returned: 0 in 0.843s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-d95b9084-2487-4f25-9849-b14f235be268" released by "_delete_snapshot" :: held 3.632s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" released by "delete_snapshot" :: held 3.659s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Created reservations ['1c56233d-4745-4b77-b57f-b82117549b04', '563f97df-93d3-455f-855a-3cac3958ad43', '6cb29570-a08b-41f5-9674-9f2e705003a7', '70cbbad4-236d-4ea0-a301-5d2c41c39dea'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Delete snapshot completed successfully. Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab59376b-fea9-488c-a7d0-f8396a179971 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-d95b9084-2487-4f25-9849-b14f235be268-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-ebd23dfb-df2d-4360-9ca7-36686a349f62-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-ebd23dfb-df2d-4360-9ca7-36686a349f62-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc9a9e-1236-460c-b73e-18add931b893]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:49 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:49 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:51 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 1.241s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:51 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62 Apr 30 11:05:51 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (d9def4c8-8234-4ab7-9372-3621c4f2b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9c88fc-17fa-4169-8d7a-54f9c9dce1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9c88fc-17fa-4169-8d7a-54f9c9dce1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350612911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61cc915-e338-4718-a354-b62d7445be8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:52Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc6fcc3-bb89-42ee-a447-2b4e301d572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc6fcc3-bb89-42ee-a447-2b4e301d572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb29b166-9b0d-4761-8fca-1dc9a2533460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb29b166-9b0d-4761-8fca-1dc9a2533460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61cc915-e338-4718-a354-b62d7445be8c', 'volume_name': 'volume-a61cc915-e338-4718-a354-b62d7445be8c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5d5353-143d-4bf4-a7ca-ec16623e0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5d5353-143d-4bf4-a7ca-ec16623e0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966bb295-163a-4e42-b7e1-57763ac7e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Volume a61cc915-e338-4718-a354-b62d7445be8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61cc915-e338-4718-a354-b62d7445be8c', 'volume_size': 1} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350612911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61cc915-e338-4718-a354-b62d7445be8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:52Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Creating volume a61cc915-e338-4718-a354-b62d7445be8c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:51 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:51 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c 1073741824 Apr 30 11:05:51 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:52 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ebd23dfb-df2d-4360-9ca7-36686a349f62" returned: 0 in 1.197s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-ebd23dfb-df2d-4360-9ca7-36686a349f62" released by "delete_volume" :: held 2.520s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Created reservations ['761ee9c4-fbbb-4a73-acf9-8dded32a4d1b', 'ce2341f8-bbc2-4a5c-b8b2-1f47957e2195', '371daf14-e56b-4282-9b7c-5ba57432b47a', '0306de30-ec5b-4c88-a0a2-3c6523436a3b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:52 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:52 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6-delete_volume" acquired by "delete_volume" :: waited 0.239s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:53 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c 1073741824" returned: 0 in 1.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9244da2-d212-4efd-b325-c815f65acdac]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:53 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c Apr 30 11:05:53 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:53 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 Apr 30 11:05:53 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:53 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.396s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Deleted volume successfully. Apr 30 11:05:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-05447e91-8550-483a-90dd-adc687631ed8 tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-ebd23dfb-df2d-4360-9ca7-36686a349f62-delete_volume" released by "delete_volume" :: held 4.178s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:54 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c" returned: 0 in 0.982s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] <== create_volume: return (2766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.770s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966bb295-163a-4e42-b7e1-57763ac7e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61cc915-e338-4718-a354-b62d7445be8c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3c79c8-4751-4987-8ae6-d0179abc1e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:54 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Volume volume-a61cc915-e338-4718-a354-b62d7445be8c (a61cc915-e338-4718-a354-b62d7445be8c): created successfully Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3c79c8-4751-4987-8ae6-d0179abc1e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (d9def4c8-8234-4ab7-9372-3621c4f2b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" returned: 0 in 1.124s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c3763af6-7e39-4f39-86ae-16be00041afb tempest-VolumesListTestJSON-1900670145 None] Created volume successfully. Apr 30 11:05:54 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6 Apr 30 11:05:54 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:55 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" returned: 0 in 1.058s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-quobyte-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6" released by "delete_volume" :: held 2.289s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=88,cinder:SELECT=75,cinder:INSERT=26,cinder:DELETE=9 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:55 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=59,cinder:INSERT=18,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:55 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Created reservations ['a25e6e36-5cde-4a57-a03d-990b43f4091f', 'a864d8b5-0494-4bfd-99f5-5d98e877c9e2', '481d6d37-0990-451d-bb9b-2e59af894e9f', '2343eccc-808f-40b7-a074-c22a36c4ddf9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:56 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:05:56 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (999f3e30-b866-40a1-8d13-385e31a3a32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f314cdd-1e30-4666-96d7-d4a96dfb5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f314cdd-1e30-4666-96d7-d4a96dfb5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1795911859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ba08f-01d6-4fa2-ba45-d2a354a50dad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:57Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d854aa-b50b-4897-a2c3-65422ed26d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d854aa-b50b-4897-a2c3-65422ed26d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b646f6-be2e-4251-84c7-007ecfaf991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b646f6-be2e-4251-84c7-007ecfaf991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641ba08f-01d6-4fa2-ba45-d2a354a50dad', 'volume_name': 'volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81ea0d2-be70-4421-8d25-c27f9278887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81ea0d2-be70-4421-8d25-c27f9278887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1b01c9-b613-42bd-8195-02b30e09181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Volume 641ba08f-01d6-4fa2-ba45-d2a354a50dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad', 'volume_size': 1} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1795911859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ba08f-01d6-4fa2-ba45-d2a354a50dad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:57Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Creating volume 641ba08f-01d6-4fa2-ba45-d2a354a50dad {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:57 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Flow 'volume_create_manager' (ebabad8d-716d-4879-8c1d-f5e0b2aacf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef447ac1-acf6-4125-ae6f-420ac151d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef447ac1-acf6-4125-ae6f-420ac151d722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-863360389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fd370c-2df8-4761-9020-23646f5ebbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4293db161d34f78b9a7c77c6d7b4653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:57Z,use_quota=True,user_id='27a08b9160d2430c854478639b343b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d24203-d9f9-4d5b-8644-f3bcae7dcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d24203-d9f9-4d5b-8644-f3bcae7dcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8824a42a-1047-4a47-a65a-bceaf5dfe7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad 1073741824 Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8824a42a-1047-4a47-a65a-bceaf5dfe7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fd370c-2df8-4761-9020-23646f5ebbd3', 'volume_name': 'volume-81fd370c-2df8-4761-9020-23646f5ebbd3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32f809-f3a6-4298-a16b-a3ddf545dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32f809-f3a6-4298-a16b-a3ddf545dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22accc5b-47b2-4026-a88c-d568982e6c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:57 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Volume 81fd370c-2df8-4761-9020-23646f5ebbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fd370c-2df8-4761-9020-23646f5ebbd3', 'volume_size': 1} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:57 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Deleted volume successfully. Apr 30 11:05:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-4203d337-4f0d-455e-a04d-8f145e03bb7d tempest-SnapshotDependencyTests-1186289076 None] Lock "cinder-14ef4167-3cab-44ba-a2b6-2d775dd2f3c6-delete_volume" released by "delete_volume" :: held 4.590s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:58 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad 1073741824" returned: 0 in 1.258s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:58 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad Apr 30 11:05:58 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:59 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad" returned: 0 in 0.915s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-863360389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fd370c-2df8-4761-9020-23646f5ebbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4293db161d34f78b9a7c77c6d7b4653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:57Z,use_quota=True,user_id='27a08b9160d2430c854478639b343b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Creating volume 81fd370c-2df8-4761-9020-23646f5ebbd3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:59 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1b01c9-b613-42bd-8195-02b30e09181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef360f9-0116-4043-94ce-e97bcdc9b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:59 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 1073741824 Apr 30 11:05:59 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:59 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Volume volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad (641ba08f-01d6-4fa2-ba45-d2a354a50dad): created successfully Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef360f9-0116-4043-94ce-e97bcdc9b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (999f3e30-b866-40a1-8d13-385e31a3a32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0c246abd-a6ce-4418-9829-52422cf4bf5e tempest-VolumesListTestJSON-1900670145 None] Created volume successfully. Apr 30 11:06:00 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 1073741824" returned: 0 in 1.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:01 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 Apr 30 11:06:01 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (5b17edab-9a62-49b6-9f10-c9ed433f75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3adef1-ac8c-43c2-89d6-fba01068b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3adef1-ac8c-43c2-89d6-fba01068b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-751407303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42786c5-1280-41d4-b844-0cc2effd4d98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:01Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3295018-f22b-4da9-9d2c-a6159f3fbf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3295018-f22b-4da9-9d2c-a6159f3fbf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52792f15-bac7-4949-b3d3-2591e0e85815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52792f15-bac7-4949-b3d3-2591e0e85815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42786c5-1280-41d4-b844-0cc2effd4d98', 'volume_name': 'volume-f42786c5-1280-41d4-b844-0cc2effd4d98', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb926ea-4f99-48d7-b881-a2e26066759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb926ea-4f99-48d7-b881-a2e26066759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b50a0ba-95c1-4b3e-9fc9-09df5f800420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Volume f42786c5-1280-41d4-b844-0cc2effd4d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42786c5-1280-41d4-b844-0cc2effd4d98', 'volume_size': 1} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:01 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3" returned: 0 in 0.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-751407303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42786c5-1280-41d4-b844-0cc2effd4d98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc4276aa6a2046df87e63d72c05f781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:01Z,use_quota=True,user_id='55a870425c394296ba16aae0778a209c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Creating volume f42786c5-1280-41d4-b844-0cc2effd4d98 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:01 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22accc5b-47b2-4026-a88c-d568982e6c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fd370c-2df8-4761-9020-23646f5ebbd3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1569975d-01d5-4e77-a29a-035f4176ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:01 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Volume volume-81fd370c-2df8-4761-9020-23646f5ebbd3 (81fd370c-2df8-4761-9020-23646f5ebbd3): created successfully Apr 30 11:06:01 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 1073741824 Apr 30 11:06:01 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1569975d-01d5-4e77-a29a-035f4176ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Flow 'volume_create_manager' (ebabad8d-716d-4879-8c1d-f5e0b2aacf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-582b60ef-e208-40c9-ae3f-02b816adb351 tempest-TestMinimumBasicScenario-1975737387 None] Created volume successfully. Apr 30 11:06:03 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 1073741824" returned: 0 in 1.591s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:03 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 Apr 30 11:06:03 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:04 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98" returned: 0 in 0.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] <== create_volume: return (2599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b50a0ba-95c1-4b3e-9fc9-09df5f800420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42786c5-1280-41d4-b844-0cc2effd4d98', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7234e6-b39c-4b18-9982-d3d9d823e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Volume volume-f42786c5-1280-41d4-b844-0cc2effd4d98 (f42786c5-1280-41d4-b844-0cc2effd4d98): created successfully Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7234e6-b39c-4b18-9982-d3d9d823e153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Flow 'volume_create_manager' (5b17edab-9a62-49b6-9f10-c9ed433f75ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1665e1f9-de05-48ee-8aab-0b0bc7b83c29 tempest-VolumesListTestJSON-1900670145 None] Created volume successfully. Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:06 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:06:06 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfdb1c7-243b-4754-92b6-fecbf7a6de7a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:06 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.819s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:06 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 Apr 30 11:06:06 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:07 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3" returned: 0 in 1.033s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.063s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-81fd370c-2df8-4761-9020-23646f5ebbd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '451f3d69-4b42-4bc6-a027-bf7f7d6634b6', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:06:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-03515fe5-4b7b-46fb-96cf-94c30552f487 req-9afc7c7a-27c5-47cc-8ac5-376a1848ec68 tempest-TestMinimumBasicScenario-1975737387 None] attachment_update completed successfully. Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-f42786c5-1280-41d4-b844-0cc2effd4d98-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-f42786c5-1280-41d4-b844-0cc2effd4d98-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-quobyte-f42786c5-1280-41d4-b844-0cc2effd4d98" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-f42786c5-1280-41d4-b844-0cc2effd4d98" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c1e0a8-fc57-4572-bd3b-7143efad99f5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:08 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 Apr 30 11:06:08 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:09 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98" returned: 0 in 0.966s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:09 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98 Apr 30 11:06:09 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:09 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f42786c5-1280-41d4-b844-0cc2effd4d98" returned: 0 in 0.754s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-f42786c5-1280-41d4-b844-0cc2effd4d98" released by "delete_volume" :: held 1.782s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:09 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Created reservations ['d8b4d78b-d68e-44e2-9f67-e2019736f602', 'e5e02c61-18d0-4902-9195-a550dc31ad3a', '02b066d5-dc3d-4a47-8ee1-76166e78a469', 'e67bcfd6-7e80-481d-b10c-8eb5c8ac38ce'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:10 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:06:10 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-641ba08f-01d6-4fa2-ba45-d2a354a50dad-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-641ba08f-01d6-4fa2-ba45-d2a354a50dad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-quobyte-641ba08f-01d6-4fa2-ba45-d2a354a50dad" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-641ba08f-01d6-4fa2-ba45-d2a354a50dad" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[325aaa08-ce6f-46bd-a3ab-1092d4ab7e9f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:10 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad Apr 30 11:06:10 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:10 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.761s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Deleted volume successfully. Apr 30 11:06:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0aab8942-e51e-4423-88bd-3f2089553e89 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-f42786c5-1280-41d4-b844-0cc2effd4d98-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:11 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad" returned: 0 in 1.160s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:11 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad Apr 30 11:06:11 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:12 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-641ba08f-01d6-4fa2-ba45-d2a354a50dad" returned: 0 in 0.761s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-641ba08f-01d6-4fa2-ba45-d2a354a50dad" released by "delete_volume" :: held 1.973s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Created reservations ['6d7a5025-6b0e-41d8-9430-e15e6c2b2d52', '6cf847bf-1011-4eee-abe5-ca280b9eb202', '80100dde-5fde-41df-8eb3-f1376c55589f', '9df87c3d-d5e6-416f-8b7b-e6034c7bef1d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:12 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:06:12 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-a61cc915-e338-4718-a354-b62d7445be8c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-a61cc915-e338-4718-a354-b62d7445be8c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "cinder-quobyte-a61cc915-e338-4718-a354-b62d7445be8c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-a61cc915-e338-4718-a354-b62d7445be8c" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346c631-3200-4c97-9c6e-9a61d333316d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:13 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c Apr 30 11:06:13 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:13 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.204s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:13 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Deleted volume successfully. Apr 30 11:06:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3ef05177-35d4-4caa-bb6e-72c01b61550d tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-641ba08f-01d6-4fa2-ba45-d2a354a50dad-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:14 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c" returned: 0 in 1.073s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:14 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c Apr 30 11:06:14 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:14 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a61cc915-e338-4718-a354-b62d7445be8c" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-quobyte-a61cc915-e338-4718-a354-b62d7445be8c" released by "delete_volume" :: held 1.877s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Created reservations ['4a11d825-bfe0-43f6-8aef-57ffa085eab9', '8ef8dad3-ce8c-43af-ab27-bbb5ea9b9651', 'c9c2ec0a-7910-42b5-a281-a952fb40d4b3', '41fb4ca5-c32c-4135-9410-09bf78127f8a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:14 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:06:14 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:15 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.787s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:15 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Deleted volume successfully. Apr 30 11:06:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82e8d474-93fc-4b0f-9d30-ed440a3bbf79 tempest-VolumesListTestJSON-1900670145 None] Lock "cinder-a61cc915-e338-4718-a354-b62d7445be8c-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Flow 'volume_create_manager' (051e8255-9785-411c-8107-c18063d5a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e870f-74d1-4a86-aa44-cb28b5710a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e870f-74d1-4a86-aa44-cb28b5710a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1182514843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf7189f-3a94-4920-a137-9ddf496c5731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd5562759f643628e1d058b57b3d966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:19Z,use_quota=True,user_id='fa4eaa2e3fc14175949891c43a8239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fedf36-ae01-4c27-a60d-0593ec4e2d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fedf36-ae01-4c27-a60d-0593ec4e2d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba70ef6-6b36-46a7-95c3-d7fa9a1c0ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba70ef6-6b36-46a7-95c3-d7fa9a1c0ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf7189f-3a94-4920-a137-9ddf496c5731', 'volume_name': 'volume-dcf7189f-3a94-4920-a137-9ddf496c5731', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567ad3eb-2bd0-4577-8de6-a853c7896008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567ad3eb-2bd0-4577-8de6-a853c7896008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe43bd5-f7f6-4188-8866-8e29c7bca91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Volume dcf7189f-3a94-4920-a137-9ddf496c5731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf7189f-3a94-4920-a137-9ddf496c5731', 'volume_size': 1} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1182514843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf7189f-3a94-4920-a137-9ddf496c5731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd5562759f643628e1d058b57b3d966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:19Z,use_quota=True,user_id='fa4eaa2e3fc14175949891c43a8239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Creating volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:18 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:06:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:18 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 1073741824 Apr 30 11:06:18 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:19 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 1073741824" returned: 0 in 0.890s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:19 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 Apr 30 11:06:19 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:20 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731" returned: 0 in 0.648s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe43bd5-f7f6-4188-8866-8e29c7bca91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf7189f-3a94-4920-a137-9ddf496c5731', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7993c6-7fe4-494e-96fa-9d3f2e244e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Volume volume-dcf7189f-3a94-4920-a137-9ddf496c5731 (dcf7189f-3a94-4920-a137-9ddf496c5731): created successfully Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7993c6-7fe4-494e-96fa-9d3f2e244e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Flow 'volume_create_manager' (051e8255-9785-411c-8107-c18063d5a556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d27edf04-d213-4f2f-8817-98461f0e85e2 tempest-VolumesSnapshotListTestJSON-2141643614 None] Created volume successfully. Apr 30 11:06:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:21 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Creating offline snapshot f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:06:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecadaa57-434b-490a-ab03-824b33660920]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:21 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 Apr 30 11:06:21 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:22 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731" returned: 0 in 1.270s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:22 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a 1G Apr 30 11:06:22 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:23 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a 1G" returned: 0 in 0.873s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:23 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:23 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:23 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.679s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:24 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a is being set with open permissions: ugo+rw Apr 30 11:06:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:24 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:24 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:24 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:24 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info Apr 30 11:06:24 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:25 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:25 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info is being set with open permissions: ugo+rw Apr 30 11:06:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:25 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info Apr 30 11:06:25 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:26 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.info" returned: 0 in 1.065s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.336s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:26 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3c678394-3199-4d79-8d38-7d5d9127ed6c tempest-VolumesSnapshotListTestJSON-2141643614 None] Create snapshot completed successfully Apr 30 11:06:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Creating offline snapshot c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:06:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab76445-823f-47bc-9ae4-ffe73aef9467]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:27 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:27 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:28 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:28 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 1G Apr 30 11:06:28 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:29 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 1G" returned: 0 in 1.400s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:29 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:29 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:30 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 1.016s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:30 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 is being set with open permissions: ugo+rw Apr 30 11:06:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:30 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:30 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:31 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.707s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-066d9bc7-3e8a-4619-9d9e-45c9a7bb4e49 tempest-VolumesSnapshotListTestJSON-2141643614 None] Create snapshot completed successfully Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Creating offline snapshot 66402d8f-26ac-4a5f-bee2-ad545ea39e47 of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc420f-de5f-4803-acb9-8400263273d3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:32 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:32 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:32 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:33 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 1G Apr 30 11:06:33 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:33 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 1G" returned: 0 in 0.822s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:33 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 Apr 30 11:06:33 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:34 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47" returned: 0 in 0.672s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:34 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 is being set with open permissions: ugo+rw Apr 30 11:06:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:34 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 Apr 30 11:06:34 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:35 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47" returned: 0 in 0.578s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b9110cfc-4dd0-40c8-a19a-097f19584065 tempest-VolumesSnapshotListTestJSON-2141643614 None] Create snapshot completed successfully Apr 30 11:06:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-66402d8f-26ac-4a5f-bee2-ad545ea39e47-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-66402d8f-26ac-4a5f-bee2-ad545ea39e47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-66402d8f-26ac-4a5f-bee2-ad545ea39e47" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-66402d8f-26ac-4a5f-bee2-ad545ea39e47" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Deleting offline snapshot 66402d8f-26ac-4a5f-bee2-ad545ea39e47 of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] snapshot_file for this snap is: volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[97668349-106e-4c43-8928-6482cb14ed59]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:36 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 Apr 30 11:06:36 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:36 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47" returned: 0 in 0.687s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940b1c4-be8a-46d9-9d97-189f2f9474b6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:36 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:36 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:37 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.679s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:37 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 Apr 30 11:06:37 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:38 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47" returned: 0 in 0.746s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:38 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47 Apr 30 11:06:38 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:38 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.66402d8f-26ac-4a5f-bee2-ad545ea39e47" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-66402d8f-26ac-4a5f-bee2-ad545ea39e47" released by "_delete_snapshot" :: held 2.824s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" released by "delete_snapshot" :: held 2.855s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:38 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Created reservations ['9c01a4fd-608b-4fc6-a0a4-c2b02620f736', '22cb10a3-0d88-4383-8bf7-c712d9c5d40a', '45d930b1-0c47-4b8e-8a0d-8089e3f46018', '8d6ecccc-8e54-4f10-9c48-f17c3e80a3e7'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Delete snapshot completed successfully. Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-59855d1d-5adf-4e15-bae7-11f706009259 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-66402d8f-26ac-4a5f-bee2-ad545ea39e47-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Deleting offline snapshot c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] snapshot_file for this snap is: volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b43035-8e47-4570-91d3-306f7f685c66]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:39 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:39 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:39 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.720s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2f219a-05b0-4a38-a4e6-f56cf62cc83b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:40 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:40 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:40 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.713s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:40 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:40 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:41 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.820s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:41 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86 Apr 30 11:06:41 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:42 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" returned: 0 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86" released by "_delete_snapshot" :: held 3.008s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" released by "delete_snapshot" :: held 3.042s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:42 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Created reservations ['6c789a63-3b14-4648-9876-1fe43ac69af6', '7128170a-908d-4a02-b85a-f45db59324ce', '0f776262-9f0a-4e42-acf6-f571e3d3bc76', '56f24b8f-c22b-47b4-aaa7-694b2ea598ff'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Delete snapshot completed successfully. Apr 30 11:06:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d8469030-d500-42c3-b41d-6772b312f620 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-c4f7251d-ac0d-4dc7-9d5d-b80415d22b86-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Deleting offline snapshot f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a of volume dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] snapshot_file for this snap is: volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d500b5b-d5d3-4240-98bb-b5416e505209]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:43 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:43 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:44 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.681s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf7189f-3a94-4920-a137-9ddf496c5731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ed2dd-db3c-425e-8876-5a4364d35878]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:44 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 Apr 30 11:06:44 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:44 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731" returned: 0 in 0.688s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:44 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:44 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:45 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.697s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:45 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a Apr 30 11:06:45 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:46 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731.f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a" released by "_delete_snapshot" :: held 2.759s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" released by "delete_snapshot" :: held 2.789s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Created reservations ['44d1c2cf-ece8-4319-8a14-843216e1b15a', '188a47b7-b3c5-479e-9af5-fca843134519', '7282cbbc-3af3-4693-b020-b62dc35aff5f', 'eb5d7e5d-54c7-43f8-abcb-ae962eac5bdb'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Delete snapshot completed successfully. Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11ab60f1-fcf3-40fe-9841-5746b7cdf020 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-f3f1c76e-9b84-4b78-ab1d-c0f31e6f9b4a-delete_snapshot" released by "delete_snapshot" :: held 2.934s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-dcf7189f-3a94-4920-a137-9ddf496c5731-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-dcf7189f-3a94-4920-a137-9ddf496c5731-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (7f4aefda-be46-4383-a9dd-33ffbf883dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc8c9e-b15c-4033-a84f-c9dd00428be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25ca2a-e6e9-426e-b202-58f216d9f2d9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc8c9e-b15c-4033-a84f-c9dd00428be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099955194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3563bcfd-2515-4794-b1bc-c566e131a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:47Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d6d652-73c4-4937-8a2b-43874bfb3369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d6d652-73c4-4937-8a2b-43874bfb3369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec837ba-7588-4e33-8cf7-e1e2001cd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec837ba-7588-4e33-8cf7-e1e2001cd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3563bcfd-2515-4794-b1bc-c566e131a497', 'volume_name': 'volume-3563bcfd-2515-4794-b1bc-c566e131a497', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17746b7-9904-4743-a9e1-63295f6c387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17746b7-9904-4743-a9e1-63295f6c387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772571e8-8ab0-437b-8cd2-9f4efe4ae34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Volume 3563bcfd-2515-4794-b1bc-c566e131a497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3563bcfd-2515-4794-b1bc-c566e131a497', 'volume_size': 1} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099955194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3563bcfd-2515-4794-b1bc-c566e131a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:47Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Creating volume 3563bcfd-2515-4794-b1bc-c566e131a497 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:46 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:06:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:46 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 1073741824 Apr 30 11:06:46 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:46 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 Apr 30 11:06:46 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:47 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:47 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731 Apr 30 11:06:47 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:47 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 1073741824" returned: 0 in 0.841s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:47 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 Apr 30 11:06:47 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:48 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dcf7189f-3a94-4920-a137-9ddf496c5731" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-quobyte-dcf7189f-3a94-4920-a137-9ddf496c5731" released by "delete_volume" :: held 1.505s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Created reservations ['2242d325-acf1-4107-8cf0-f9fa51bc26dc', '04f0216a-6d0b-4e03-a31e-6a3b76cb0e2b', '06278d13-a52d-4625-be80-4708900488e8', '300bb2fc-b26f-4c26-a05f-51fd2c1dc09d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:48 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497" returned: 0 in 0.631s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:48 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:06:48 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772571e8-8ab0-437b-8cd2-9f4efe4ae34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3563bcfd-2515-4794-b1bc-c566e131a497', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3cd79e-9067-46fa-874e-f3d31c6728b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Volume volume-3563bcfd-2515-4794-b1bc-c566e131a497 (3563bcfd-2515-4794-b1bc-c566e131a497): created successfully Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3cd79e-9067-46fa-874e-f3d31c6728b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (7f4aefda-be46-4383-a9dd-33ffbf883dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a56aa2e8-d629-47e6-9ccd-d3e5c36587e6 tempest-AttachVolumeNegativeTest-51541391 None] Created volume successfully. Apr 30 11:06:48 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Deleted volume successfully. Apr 30 11:06:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f95256c0-9a97-45dc-94f8-3a87e475ff08 tempest-VolumesSnapshotListTestJSON-2141643614 None] Lock "cinder-dcf7189f-3a94-4920-a137-9ddf496c5731-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3c5bc-aa2a-4f06-af2d-00cc7caa994c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:52 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 Apr 30 11:06:52 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:52 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497" returned: 0 in 0.730s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.757s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-3563bcfd-2515-4794-b1bc-c566e131a497', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6c46814-1f95-4444-a6bd-8c217cdf80a1', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:06:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-70866ada-9ef5-4e9a-80a2-af597fe06cb9 req-c9769e3b-6a36-444b-bc16-c990caa7d7fb tempest-AttachVolumeNegativeTest-51541391 None] attachment_update completed successfully. Apr 30 11:06:58 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=78,cinder:SELECT=69,cinder:INSERT=16,cinder:DELETE=7 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:06:58 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=68,cinder:INSERT=22,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:06:58 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-e5404819-6c59-4deb-9f36-15bbddef653f req-c04e78cb-2435-4a3a-8737-f36f5d609404 tempest-TestMinimumBasicScenario-1975737387 None] Terminate volume connection completed successfully. Apr 30 11:06:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-e5404819-6c59-4deb-9f36-15bbddef653f req-c04e78cb-2435-4a3a-8737-f36f5d609404 tempest-TestMinimumBasicScenario-1975737387 None] Deleting attachment 451f3d69-4b42-4bc6-a027-bf7f7d6634b6. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "cinder-81fd370c-2df8-4761-9020-23646f5ebbd3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "cinder-81fd370c-2df8-4761-9020-23646f5ebbd3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "cinder-quobyte-81fd370c-2df8-4761-9020-23646f5ebbd3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "cinder-quobyte-81fd370c-2df8-4761-9020-23646f5ebbd3" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c9a18-2723-4e4b-aadd-7868b5431b48]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:00 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 Apr 30 11:07:00 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:01 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3" returned: 0 in 0.861s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:01 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3 Apr 30 11:07:01 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-81fd370c-2df8-4761-9020-23646f5ebbd3" returned: 0 in 0.653s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:01 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "cinder-quobyte-81fd370c-2df8-4761-9020-23646f5ebbd3" released by "delete_volume" :: held 1.581s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Created reservations ['e7150128-6fda-4605-85ec-f7df1828663c', 'b2366150-9ded-47e8-989b-71885fb4c59a', '29867675-5e18-494b-bed8-83887f35fad8', '51278b1a-35f6-4c9d-88b4-37472dc00df8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:02 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:07:02 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:02 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.711s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Deleted volume successfully. Apr 30 11:07:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-500ae271-ae5b-4174-9f9f-c6e305b57270 tempest-TestMinimumBasicScenario-1975737387 None] Lock "cinder-81fd370c-2df8-4761-9020-23646f5ebbd3-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:06 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:07:06 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:06 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.673s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:12 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:INSERT=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:07:12 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Flow 'volume_create_manager' (4f197a7d-371e-40fb-b3da-76d12b4f6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db0de3-9016-4409-955d-d6589f261316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db0de3-9016-4409-955d-d6589f261316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-799588669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4cf0ba-b101-4080-84f8-50eea68d3ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6b9aee45c345c0b64e966ef68b5754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:51Z,use_quota=True,user_id='6518828dc96d4fce9c326bab0396f505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc7df15-98b4-4ba3-b535-b783030eb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc7df15-98b4-4ba3-b535-b783030eb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ee55c5-aaaf-42fc-be6d-572eea087eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ee55c5-aaaf-42fc-be6d-572eea087eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'volume_name': 'volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde07ee3-a2ac-4106-a51f-0ed8b47d3df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde07ee3-a2ac-4106-a51f-0ed8b47d3df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a663c1ca-c2fa-4063-a607-5087b48b99ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Trying to clone ed4cf0ba-b101-4080-84f8-50eea68d3ad6 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:07:51 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27ea40c-4387-4e58-8216-e73f5ca1e299]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:51 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD Apr 30 11:07:51 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-aa8a0f6b-47f1-4682-b7e5-ab50d613cba3 req-ef38f165-0279-4d8e-a842-6a6b45b13a37 tempest-AttachVolumeNegativeTest-51541391 None] Terminate volume connection completed successfully. Apr 30 11:07:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-aa8a0f6b-47f1-4682-b7e5-ab50d613cba3 req-ef38f165-0279-4d8e-a842-6a6b45b13a37 tempest-AttachVolumeNegativeTest-51541391 None] Deleting attachment a6c46814-1f95-4444-a6bd-8c217cdf80a1. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:07:52 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:52 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 6518828dc96d4fce9c326bab0396f505. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:07:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc63f44-8736-4b0c-b94a-a99ff5b79e09]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:52 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD Apr 30 11:07:52 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:53 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-799588669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4cf0ba-b101-4080-84f8-50eea68d3ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6b9aee45c345c0b64e966ef68b5754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:51Z,use_quota=True,user_id='6518828dc96d4fce9c326bab0396f505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Creating volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:53 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:53 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1073741824 Apr 30 11:07:53 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:53 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1073741824" returned: 0 in 0.770s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:53 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:07:53 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:54 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.688s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9d0c6-ad83-4801-8aa0-7bf88ed09751]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Flow 'volume_create_manager' (43201892-5841-4ac6-ab5c-7a2b3aec222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1005395-b585-4d41-9ae1-3b618a3c2ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1005395-b585-4d41-9ae1-3b618a3c2ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-799057708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9e5b2-8ef5-4b81-91fc-f74468d48720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578a12921da9464d90d7a5a64c70e70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:55Z,use_quota=True,user_id='bb0f8ee5c9214e9ea13e8ea5a3dc50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e67833-6f0b-489e-bac9-9d47bc52bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e67833-6f0b-489e-bac9-9d47bc52bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68 Apr 30 11:07:54 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d92d2bd-0e83-442b-a139-df9b2297714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d92d2bd-0e83-442b-a139-df9b2297714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d9e5b2-8ef5-4b81-91fc-f74468d48720', 'volume_name': 'volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a3414-e598-4ab0-847f-b16f1dbcaa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a3414-e598-4ab0-847f-b16f1dbcaa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0a82d4-c44d-476c-80fc-7351bdab4dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Volume e7d9e5b2-8ef5-4b81-91fc-f74468d48720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720', 'volume_size': 1} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-799057708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9e5b2-8ef5-4b81-91fc-f74468d48720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578a12921da9464d90d7a5a64c70e70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:55Z,use_quota=True,user_id='bb0f8ee5c9214e9ea13e8ea5a3dc50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Creating volume e7d9e5b2-8ef5-4b81-91fc-f74468d48720 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:54 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:07:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:54 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 1073741824 Apr 30 11:07:54 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:55 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68" returned: 0 in 0.881s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:55 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68 Apr 30 11:07:55 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 1073741824" returned: 0 in 1.110s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:56 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 Apr 30 11:07:56 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68" returned: 1 in 0.742s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_k4w7n_68' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f22cff-7ae7-45a7-b1fd-98f04777c079]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:56 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD Apr 30 11:07:56 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" returned: 0 in 0.605s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0a82d4-c44d-476c-80fc-7351bdab4dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5987c6-7817-4fdf-b4e0-4ab8ba31c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Volume volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 (e7d9e5b2-8ef5-4b81-91fc-f74468d48720): created successfully Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5987c6-7817-4fdf-b4e0-4ab8ba31c540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Flow 'volume_create_manager' (43201892-5841-4ac6-ab5c-7a2b3aec222c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-20ea358f-3d29-4d2b-857f-d119551bcf05 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Created volume successfully. Apr 30 11:07:57 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:57 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:07:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:57 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:07:57 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:59 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 1.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_er4qz47ldevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:07:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Converted 112.00 MB image at 61.11 MB/s Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:59 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1G Apr 30 11:07:59 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:59 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 1G" returned: 0 in 0.640s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4673ae5-f27b-4d52-8c26-f70f3ee621c9]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:59 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:07:59 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d507c5-6ddb-41b9-afcb-837ffb436357]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:00 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 Apr 30 11:08:00 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:00 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:08:00 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" returned: 0 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.732s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06dd49cb-13b3-4df2-ab2e-5d0fff88bdff', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:08:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-45d7665a-4dcd-4046-8e2a-b8a2680e616d req-7f758438-f6a4-46c6-84a6-ec10d4e7db9c tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] attachment_update completed successfully. Apr 30 11:08:01 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 1 in 0.732s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 6518828dc96d4fce9c326bab0396f505 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Marking volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to ed4cf0ba-b101-4080-84f8-50eea68d3ad6. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Creating volume glance metadata for volume ed4cf0ba-b101-4080-84f8-50eea68d3ad6 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a663c1ca-c2fa-4063-a607-5087b48b99ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d99e175-63f6-4c63-bb72-dec105dc17b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:01 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Volume volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 (ed4cf0ba-b101-4080-84f8-50eea68d3ad6): created successfully Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d99e175-63f6-4c63-bb72-dec105dc17b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Flow 'volume_create_manager' (4f197a7d-371e-40fb-b3da-76d12b4f6422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7eb53120-404f-46b8-beb5-616279463db6 tempest-TestShelveInstance-1787095224 None] Created volume successfully. Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:06 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:06 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:06 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.613s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-0c2d8b58-cdf5-47fc-86e4-35ef5fd6fb14 req-cffff758-7474-4fed-bbdf-578d440426d4 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Terminate volume connection completed successfully. Apr 30 11:08:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-0c2d8b58-cdf5-47fc-86e4-35ef5fd6fb14 req-cffff758-7474-4fed-bbdf-578d440426d4 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Deleting attachment 06dd49cb-13b3-4df2-ab2e-5d0fff88bdff. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e32c7c-c782-428c-b41e-6389c2177d20]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:09 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:08:09 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "cinder-e7d9e5b2-8ef5-4b81-91fc-f74468d48720-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "cinder-e7d9e5b2-8ef5-4b81-91fc-f74468d48720-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "cinder-quobyte-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:09 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.911s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "cinder-quobyte-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f814d5f1-369c-4728-9116-722bd7bb25e4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:10 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:08:10 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 Apr 30 11:08:10 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" returned: 0 in 0.812s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:10 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 1 in 0.882s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.840s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:10 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720 Apr 30 11:08:10 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43570f3c-b4f5-4c05-9d0d-c903e403c9d3', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:08:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-bf63a848-bcdd-4135-8bb7-2c150cceaa34 req-61861636-5131-4196-b1c7-4ea32d8ce00f tempest-TestShelveInstance-1787095224 None] attachment_update completed successfully. Apr 30 11:08:11 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" returned: 0 in 0.822s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "cinder-quobyte-e7d9e5b2-8ef5-4b81-91fc-f74468d48720" released by "delete_volume" :: held 1.688s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Created reservations ['ed54f9d3-9d96-4f66-bac1-42cc6dec4899', '46df8c85-2264-4d57-9257-05a8715bdba5', 'a34fc22c-68a4-46c2-9761-8009d51a5ef0', '1dfcbf0e-0df5-4d2e-b653-3d4b5a615f23'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:11 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:11 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:12 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:12 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Deleted volume successfully. Apr 30 11:08:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-aa89142d-a59c-4984-ae59-0a88d6bc81d9 tempest-TestServerVolumeAttachScenarioOldVersion-1093541526 None] Lock "cinder-e7d9e5b2-8ef5-4b81-91fc-f74468d48720-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:21 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=31,cinder:UPDATE=18,cinder:INSERT=12,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:08:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (6d888277-2b28-476a-b514-08c4192f6644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f724da1-0d15-4066-ba3f-84de79ecab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f724da1-0d15-4066-ba3f-84de79ecab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095936039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c4573e-1b8d-4bc1-af3f-5ab35b7501e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:36Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c5648-1440-4110-b293-7b9d3e01e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c5648-1440-4110-b293-7b9d3e01e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f8e1e8-fedb-4daf-8c47-dd87c94d1879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f8e1e8-fedb-4daf-8c47-dd87c94d1879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c4573e-1b8d-4bc1-af3f-5ab35b7501e3', 'volume_name': 'volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8cc6a8-8818-44d8-9917-f23a0383df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8cc6a8-8818-44d8-9917-f23a0383df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeddba8-b8e8-4ede-8ca0-ec04dfbdf299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume 91c4573e-1b8d-4bc1-af3f-5ab35b7501e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3', 'volume_size': 1} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095936039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c4573e-1b8d-4bc1-af3f-5ab35b7501e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:36Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume 91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:36 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:36 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 1073741824 Apr 30 11:08:36 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:37 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 1073741824" returned: 0 in 0.767s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:37 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 Apr 30 11:08:37 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:37 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" returned: 0 in 0.566s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeddba8-b8e8-4ede-8ca0-ec04dfbdf299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38d92af-183e-46ab-9c19-035a06e6d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:37 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 (91c4573e-1b8d-4bc1-af3f-5ab35b7501e3): created successfully Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38d92af-183e-46ab-9c19-035a06e6d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (6d888277-2b28-476a-b514-08c4192f6644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-76cee794-eba2-4c3d-9769-cfbcd555c116 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (c337cfd9-72d1-4a12-af1d-7cc7a7342aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008acf4e-1dca-4c79-84da-f308cba1ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008acf4e-1dca-4c79-84da-f308cba1ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365905626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258b9b86-2f59-4937-b99f-1a5c3bd931b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac6ba1-6328-4901-b440-ce9f3ac50f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ac6ba1-6328-4901-b440-ce9f3ac50f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78060a54-e62f-4e40-b51f-936bcce8ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78060a54-e62f-4e40-b51f-936bcce8ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258b9b86-2f59-4937-b99f-1a5c3bd931b6', 'volume_name': 'volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed98c4b-bd19-4f5f-b6e8-9bc6434f7ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed98c4b-bd19-4f5f-b6e8-9bc6434f7ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727c93cf-1e08-4b30-b305-b64349298eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:38 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume 258b9b86-2f59-4937-b99f-1a5c3bd931b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6', 'volume_size': 1} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365905626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258b9b86-2f59-4937-b99f-1a5c3bd931b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume 258b9b86-2f59-4937-b99f-1a5c3bd931b6 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:38 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:38 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 1073741824 Apr 30 11:08:38 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (dadf1bbf-2bdb-40d8-b75b-0defa602393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b5b670-a84f-443c-9c37-adc3738badf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b5b670-a84f-443c-9c37-adc3738badf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966036749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241332e7-f5c3-4811-9d12-cd6d7f8039be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad5eeb3-ae60-4fad-b2e0-d5f40dc1fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad5eeb3-ae60-4fad-b2e0-d5f40dc1fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e19bf2-551c-490f-91e8-31f7908b2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e19bf2-551c-490f-91e8-31f7908b2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241332e7-f5c3-4811-9d12-cd6d7f8039be', 'volume_name': 'volume-241332e7-f5c3-4811-9d12-cd6d7f8039be', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d5593-7e37-42ea-b7c4-676a84372830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d5593-7e37-42ea-b7c4-676a84372830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e0a105-fdee-4a49-8dbb-a5a1a5b3e7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume 241332e7-f5c3-4811-9d12-cd6d7f8039be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241332e7-f5c3-4811-9d12-cd6d7f8039be', 'volume_size': 1} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (b501f63f-2d05-4808-a62d-ea4f8f68c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7793286f-2d0e-44d6-a254-4330a53ddbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7793286f-2d0e-44d6-a254-4330a53ddbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981173641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5d1b3-9f9e-46b8-b873-1f8c759c10c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08046abc-3b06-40e2-a83a-6ff80e4866b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08046abc-3b06-40e2-a83a-6ff80e4866b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b00e14-fa9b-4c01-8068-91f678c529a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b00e14-fa9b-4c01-8068-91f678c529a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea5d1b3-9f9e-46b8-b873-1f8c759c10c3', 'volume_name': 'volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09703c8d-e4d4-41be-8913-cf0f593cc26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09703c8d-e4d4-41be-8913-cf0f593cc26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a5afb9-0e35-4029-b202-a253fd35fd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume eea5d1b3-9f9e-46b8-b873-1f8c759c10c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3', 'volume_size': 1} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:39 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 1073741824" returned: 0 in 0.957s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:39 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 Apr 30 11:08:39 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (68e46046-86ec-4b7b-be7b-4a22dea586e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48e100-4cf3-4b5c-b000-bb6b07d290a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48e100-4cf3-4b5c-b000-bb6b07d290a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-456638849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce67256-bce6-496a-b582-1d641afef975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:40Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e0abd-0e96-438c-9c0e-291e66be2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629e0abd-0e96-438c-9c0e-291e66be2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2f8ad0-7f5c-441b-b1fc-d06d301a3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2f8ad0-7f5c-441b-b1fc-d06d301a3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce67256-bce6-496a-b582-1d641afef975', 'volume_name': 'volume-2ce67256-bce6-496a-b582-1d641afef975', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe85a749-01bd-4e9c-87bc-13eca387fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe85a749-01bd-4e9c-87bc-13eca387fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d0679-c6ea-4280-8dbd-88d25e19933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume 2ce67256-bce6-496a-b582-1d641afef975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce67256-bce6-496a-b582-1d641afef975', 'volume_size': 1} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (689e2888-b8d8-44b5-8698-dc9cd7813382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35802f-9b17-496d-8820-76059338053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35802f-9b17-496d-8820-76059338053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108444931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa55445-845f-40d0-98a7-e4941900988d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:40Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5280e6a3-6ae0-4ff1-afd3-9f709fea569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5280e6a3-6ae0-4ff1-afd3-9f709fea569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25440f19-bec3-4a81-a3dc-50da44b1710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25440f19-bec3-4a81-a3dc-50da44b1710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aa55445-845f-40d0-98a7-e4941900988d', 'volume_name': 'volume-5aa55445-845f-40d0-98a7-e4941900988d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a8d463-72ff-40da-a9f0-0e5fe0d0fe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a8d463-72ff-40da-a9f0-0e5fe0d0fe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4ae3a-8b9c-4b4c-9aa9-febd053a28ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume 5aa55445-845f-40d0-98a7-e4941900988d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aa55445-845f-40d0-98a7-e4941900988d', 'volume_size': 1} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:40 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6" returned: 0 in 0.778s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966036749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241332e7-f5c3-4811-9d12-cd6d7f8039be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume 241332e7-f5c3-4811-9d12-cd6d7f8039be {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:40 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727c93cf-1e08-4b30-b305-b64349298eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be 1073741824 Apr 30 11:08:40 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd414b9-0078-49fd-bd8b-d68d6bba22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 (258b9b86-2f59-4937-b99f-1a5c3bd931b6): created successfully Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd414b9-0078-49fd-bd8b-d68d6bba22c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (c337cfd9-72d1-4a12-af1d-7cc7a7342aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7c4b7916-1778-40ab-b733-d4a43f5b0881 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:41 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be 1073741824" returned: 0 in 0.909s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:41 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be Apr 30 11:08:41 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:42 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be" returned: 0 in 0.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981173641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5d1b3-9f9e-46b8-b873-1f8c759c10c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:39Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:42 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e0a105-fdee-4a49-8dbb-a5a1a5b3e7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241332e7-f5c3-4811-9d12-cd6d7f8039be', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:42 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 1073741824 Apr 30 11:08:42 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945831bf-6085-4650-a9a2-bc8fc5dd51ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-241332e7-f5c3-4811-9d12-cd6d7f8039be (241332e7-f5c3-4811-9d12-cd6d7f8039be): created successfully Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945831bf-6085-4650-a9a2-bc8fc5dd51ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (dadf1bbf-2bdb-40d8-b75b-0defa602393b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-663b73e0-7215-475e-899f-996fd21aac47 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:42 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 1073741824" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:43 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 Apr 30 11:08:43 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:43 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.669s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-456638849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce67256-bce6-496a-b582-1d641afef975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:40Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume 2ce67256-bce6-496a-b582-1d641afef975 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:43 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:43 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 1073741824 Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a5afb9-0e35-4029-b202-a253fd35fd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:43 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1344bedf-5af6-4fd0-980c-cb67ac66c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 (eea5d1b3-9f9e-46b8-b873-1f8c759c10c3): created successfully Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1344bedf-5af6-4fd0-980c-cb67ac66c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (b501f63f-2d05-4808-a62d-ea4f8f68c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-76a238db-9388-45ed-874c-a69dfa2beb42 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (253f2270-1948-4ca8-a45a-43246aa0f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84771e54-7ac4-4784-b3a3-5db4e9b24c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84771e54-7ac4-4784-b3a3-5db4e9b24c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1238952099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732e9b1e-a1bf-44d7-9df8-ebf82d06525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:44Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e457ef93-ec42-4cf9-87a3-71b70d8ef6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e457ef93-ec42-4cf9-87a3-71b70d8ef6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827f8b37-b380-4621-ade9-b7aa6f970124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827f8b37-b380-4621-ade9-b7aa6f970124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732e9b1e-a1bf-44d7-9df8-ebf82d06525f', 'volume_name': 'volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7299b1f-7305-4c5c-a726-ff0888e2bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7299b1f-7305-4c5c-a726-ff0888e2bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bb6c4a-02cc-4ec0-88c5-74deefaf1ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Volume 732e9b1e-a1bf-44d7-9df8-ebf82d06525f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f', 'volume_size': 1} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:44 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 1073741824" returned: 0 in 0.966s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:44 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 Apr 30 11:08:44 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:45 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975" returned: 0 in 0.732s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.961s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108444931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa55445-845f-40d0-98a7-e4941900988d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195da7dffbbc48e9a53d489f6f45a8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:40Z,use_quota=True,user_id='6a747e59b5694a5eaa6eabeb42f60ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Creating volume 5aa55445-845f-40d0-98a7-e4941900988d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:45 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d0679-c6ea-4280-8dbd-88d25e19933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce67256-bce6-496a-b582-1d641afef975', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd4a52c-1fff-4860-bd80-23a543410dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:45 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d 1073741824 Apr 30 11:08:45 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:45 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-2ce67256-bce6-496a-b582-1d641afef975 (2ce67256-bce6-496a-b582-1d641afef975): created successfully Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd4a52c-1fff-4860-bd80-23a543410dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (68e46046-86ec-4b7b-be7b-4a22dea586e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f757d2d5-45d7-4764-b8c8-f3fa27c5fe53 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:46 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d 1073741824" returned: 0 in 0.886s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:46 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d Apr 30 11:08:46 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:47 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1238952099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732e9b1e-a1bf-44d7-9df8-ebf82d06525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:44Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Creating volume 732e9b1e-a1bf-44d7-9df8-ebf82d06525f {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:47 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f 1073741824 Apr 30 11:08:47 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4ae3a-8b9c-4b4c-9aa9-febd053a28ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa55445-845f-40d0-98a7-e4941900988d', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3ab2f-504b-4f89-87d0-9ed541216e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Volume volume-5aa55445-845f-40d0-98a7-e4941900988d (5aa55445-845f-40d0-98a7-e4941900988d): created successfully Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3ab2f-504b-4f89-87d0-9ed541216e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Flow 'volume_create_manager' (689e2888-b8d8-44b5-8698-dc9cd7813382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-54c90c10-742a-4374-b108-80b677ce6e92 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created volume successfully. Apr 30 11:08:47 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f 1073741824" returned: 0 in 0.872s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f Apr 30 11:08:47 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-5aa55445-845f-40d0-98a7-e4941900988d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-5aa55445-845f-40d0-98a7-e4941900988d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-5aa55445-845f-40d0-98a7-e4941900988d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-5aa55445-845f-40d0-98a7-e4941900988d" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ec97a9-d172-4015-8dfc-fa21fd45c25a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:48 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d Apr 30 11:08:48 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:48 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bb6c4a-02cc-4ec0-88c5-74deefaf1ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3005b0-2982-4cda-82d4-445684b0b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Volume volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f (732e9b1e-a1bf-44d7-9df8-ebf82d06525f): created successfully Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3005b0-2982-4cda-82d4-445684b0b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (253f2270-1948-4ca8-a45a-43246aa0f68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-de8a54e7-8302-4c28-a090-295aa2129bf4 tempest-AttachVolumeNegativeTest-51541391 None] Created volume successfully. Apr 30 11:08:49 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d" returned: 0 in 1.018s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:49 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d Apr 30 11:08:49 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:49 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5aa55445-845f-40d0-98a7-e4941900988d" returned: 0 in 0.704s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-5aa55445-845f-40d0-98a7-e4941900988d" released by "delete_volume" :: held 1.768s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['c6129988-b112-41c2-b5b7-31d659aa3b16', 'f1225c6b-adcf-483b-ad07-c7bab2d84acd', '70705aed-ec43-46f3-a3dc-4ee94d6aee27', 'e20e9bbc-d3d5-42ac-a96b-36dfb06e6bb9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:50 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-2ce67256-bce6-496a-b582-1d641afef975-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-2ce67256-bce6-496a-b582-1d641afef975-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-2ce67256-bce6-496a-b582-1d641afef975" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-2ce67256-bce6-496a-b582-1d641afef975" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71f3042-9f53-4164-9bcd-328a0a5253b6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 Apr 30 11:08:50 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:50 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.795s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:08:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6891101-b738-4531-9fce-0fececc93851 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-5aa55445-845f-40d0-98a7-e4941900988d-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:51 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975" returned: 0 in 0.873s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:51 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975 Apr 30 11:08:51 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:52 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ce67256-bce6-496a-b582-1d641afef975" returned: 0 in 0.803s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-2ce67256-bce6-496a-b582-1d641afef975" released by "delete_volume" :: held 1.728s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['2d25ea1d-d51e-41f5-a501-718a99f737b2', '3a24a05d-e91c-43bf-9fa8-a19f954a456a', '1ffd521d-1724-43a8-a89f-fea8da2cf107', '0ce59a01-9b13-4580-a122-2d2181df92ef'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:52 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:52 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[14239e16-89ff-4ef4-b5b9-3e331e3648b6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ababb-0031-44c0-ae58-0b4c0fdf3eb1]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:52 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f Apr 30 11:08:52 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:52 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 Apr 30 11:08:53 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:53 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.782s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5dad5770-10ed-4d61-a3c1-5c7d0e5fe81b tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-2ce67256-bce6-496a-b582-1d641afef975-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-80b309f7-e94c-4beb-be59-1d984afd4fb0 req-ce7b49c0-1f75-42b9-92b7-ab8d5e13085d tempest-TestShelveInstance-1787095224 None] Terminate volume connection completed successfully. Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-80b309f7-e94c-4beb-be59-1d984afd4fb0 req-ce7b49c0-1f75-42b9-92b7-ab8d5e13085d tempest-TestShelveInstance-1787095224 None] Deleting attachment 43570f3c-b4f5-4c05-9d0d-c903e403c9d3. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:08:53 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" returned: 0 in 0.869s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c67bfd2-5070-4305-9017-2cc17f1b8aca', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:08:53 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" returned: 0 in 0.877s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:53 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3 Apr 30 11:08:53 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-de16d092-aae4-42a9-8131-df474188ee47 req-dea58e02-c10c-4426-b1ae-21a8ba2af0f6 tempest-AttachVolumeNegativeTest-51541391 None] attachment_update completed successfully. Apr 30 11:08:54 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" returned: 0 in 0.583s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3" released by "delete_volume" :: held 1.524s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['009eb0ce-3b40-4bf3-8104-740ef4f33754', 'c95a7acf-4073-44d1-bf69-81c861d58593', '19219c07-5c6f-43fb-91b5-8e4d1bac36cd', '7082e0d1-90da-4c88-aedf-c27b9fdd5ba2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:54 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:54 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-241332e7-f5c3-4811-9d12-cd6d7f8039be-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-241332e7-f5c3-4811-9d12-cd6d7f8039be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-241332e7-f5c3-4811-9d12-cd6d7f8039be" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-241332e7-f5c3-4811-9d12-cd6d7f8039be" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9b66f4-becc-49e2-bbf1-694bedcf0de8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:55 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f917690-60d1-4214-ba94-70f3ad0e80f6 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-eea5d1b3-9f9e-46b8-b873-1f8c759c10c3-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:55 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be Apr 30 11:08:55 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:55 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be" returned: 0 in 0.714s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:55 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be Apr 30 11:08:55 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:56 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-241332e7-f5c3-4811-9d12-cd6d7f8039be" returned: 0 in 0.610s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-241332e7-f5c3-4811-9d12-cd6d7f8039be" released by "delete_volume" :: held 1.380s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['1906d09c-95bd-4613-b436-3f58bc7c9a7a', 'b80acc95-19a1-4816-a36d-46e911aa06ef', '25ce4acf-72a1-4715-aa0e-c8880adee75b', '43a73250-e3a8-4929-b679-ce4d4d36abab'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:56 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:56 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-258b9b86-2f59-4937-b99f-1a5c3bd931b6-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:57 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-258b9b86-2f59-4937-b99f-1a5c3bd931b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-23b972cf-50a0-4b43-8b38-3f7b0c41ee23 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-241332e7-f5c3-4811-9d12-cd6d7f8039be-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-258b9b86-2f59-4937-b99f-1a5c3bd931b6" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-258b9b86-2f59-4937-b99f-1a5c3bd931b6" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a154af4-485c-4456-9c0f-8a2f55fe120f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:57 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 Apr 30 11:08:57 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:58 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6" returned: 0 in 0.757s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:58 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6 Apr 30 11:08:58 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:58 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-258b9b86-2f59-4937-b99f-1a5c3bd931b6" returned: 0 in 0.616s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-258b9b86-2f59-4937-b99f-1a5c3bd931b6" released by "delete_volume" :: held 1.416s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['1d13109f-4481-4353-b5bf-02bb118fb05b', '0d23770d-45f0-4dc4-8e84-6b0f7f4bc8e1', '04f3eef6-a0a2-4a6f-90a3-7028340a76eb', '96d81fd4-423b-40f4-976b-3aaefd885b1e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:58 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:08:58 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ecd8c-cb7b-4597-9b83-64c2517cd14c]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "cinder-quobyte-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:59 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:08:59 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[57092088-0875-4178-a897-ba250b15ff8d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:59 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 Apr 30 11:08:59 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:59 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.887s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:08:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ac5a415c-17a8-4828-9b51-13d47c0ce705 tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-258b9b86-2f59-4937-b99f-1a5c3bd931b6-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:00 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.824s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:00 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:09:00 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:00 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" returned: 0 in 0.781s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:00 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3 Apr 30 11:09:00 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:00 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-740f047f-348c-4331-84c9-9a4273917133 req-3c4b6e52-8521-40b4-88f9-cbb1a9fcec3d tempest-AttachVolumeNegativeTest-51541391 None] Terminate volume connection completed successfully. Apr 30 11:09:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-740f047f-348c-4331-84c9-9a4273917133 req-3c4b6e52-8521-40b4-88f9-cbb1a9fcec3d tempest-AttachVolumeNegativeTest-51541391 None] Deleting attachment 3c67bfd2-5070-4305-9017-2cc17f1b8aca. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:09:01 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 1 in 0.786s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.662s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:01 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" returned: 0 in 0.667s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-quobyte-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3" released by "delete_volume" :: held 1.498s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02ceea86-1ade-49a4-9dfb-8baeae101749', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Created reservations ['bd5c5948-2375-4b5e-90e0-f780c40f2483', 'aea5715e-6c53-4da0-88e6-9f28574625c2', '63b9615d-a262-4eb4-98b3-8e44863d0720', '8f5ee8b4-a752-4393-8ddf-3bb0111bdf8f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-589825c1-c8cf-4dc5-8ce1-b70c04e83690 req-f41e54f1-96c7-493f-a1a7-3445125bda96 tempest-TestShelveInstance-1787095224 None] attachment_update completed successfully. Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:01 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:01 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:01 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Deleted volume successfully. Apr 30 11:09:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f2ecc6b-3d79-4b53-9592-27c91a0df9df tempest-CreateVolumesFromSourceVolumeTest-556972188 None] Lock "cinder-91c4573e-1b8d-4bc1-af3f-5ab35b7501e3-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (bb51e48f-9b26-4e9d-bb25-8e902bf9921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6681a9-3f2e-456c-999f-187d38aea365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6681a9-3f2e-456c-999f-187d38aea365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1596015027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732486d4-a8cc-4eaf-a95b-4a59e8f65633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:05Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fadfb1a-a42a-469c-8ace-66204e12cc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fadfb1a-a42a-469c-8ace-66204e12cc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14831a5-5d07-4c00-b555-bed5db6c62be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14831a5-5d07-4c00-b555-bed5db6c62be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732486d4-a8cc-4eaf-a95b-4a59e8f65633', 'volume_name': 'volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12568239-1f61-4989-8ff1-355fee411b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12568239-1f61-4989-8ff1-355fee411b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344a9a6a-dcc8-4694-920f-9b8970ff3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:05 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Volume 732486d4-a8cc-4eaf-a95b-4a59e8f65633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633', 'volume_size': 1} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1596015027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732486d4-a8cc-4eaf-a95b-4a59e8f65633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:05Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Creating volume 732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:05 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:09:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:05 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 1073741824 Apr 30 11:09:05 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:06 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:06 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:06 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 1073741824" returned: 0 in 1.042s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:06 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:06 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:06 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.721s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:07 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344a9a6a-dcc8-4694-920f-9b8970ff3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d442ac45-48a1-4e6f-aabe-30cb5fbe2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Volume volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 (732486d4-a8cc-4eaf-a95b-4a59e8f65633): created successfully Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d442ac45-48a1-4e6f-aabe-30cb5fbe2978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (bb51e48f-9b26-4e9d-bb25-8e902bf9921a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1230e3f5-7f52-42b3-b11c-e0186a72909b tempest-VolumeDependencyTests-1970605660 None] Created volume successfully. Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Creating offline snapshot d461c20f-4605-4b88-8fcb-8c195dc651f4 of volume 732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0743f798-6391-4f84-950a-3c6c4d7d9cda]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:07 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:07 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:08 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:08 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 1G Apr 30 11:09:08 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:09 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 1G" returned: 0 in 0.812s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:09 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:09 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:10 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:10 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 is being set with open permissions: ugo+rw Apr 30 11:09:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:10 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:10 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:10 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.615s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:10 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info Apr 30 11:09:10 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:11 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info" returned: 0 in 0.615s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:11 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info is being set with open permissions: ugo+rw Apr 30 11:09:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:11 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info Apr 30 11:09:11 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:12 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.info" returned: 0 in 0.607s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.296s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d8a6af69-ceae-49ce-9567-6dc885480b28 tempest-VolumeDependencyTests-1970605660 None] Create snapshot completed successfully Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (4f6a52a9-0ceb-4d12-bae7-3bd155242416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846d2710-42f8-46e9-ac0a-16a022bded9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846d2710-42f8-46e9-ac0a-16a022bded9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-234807932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5598897-d057-4d37-a00d-0c83f1a913ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d461c20f-4605-4b88-8fcb-8c195dc651f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:13Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbea31b-cdbc-425a-9b8a-2fc998dad0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbea31b-cdbc-425a-9b8a-2fc998dad0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5dfde6-4911-4b1f-836c-f5f46615403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5dfde6-4911-4b1f-836c-f5f46615403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5598897-d057-4d37-a00d-0c83f1a913ff', 'volume_name': 'volume-b5598897-d057-4d37-a00d-0c83f1a913ff', 'volume_size': 1, 'snapshot_id': 'd461c20f-4605-4b88-8fcb-8c195dc651f4'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c29574-6261-484f-832a-6125f38093b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c29574-6261-484f-832a-6125f38093b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e56d7ec-703e-468b-9f71-de4d9c9edfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Volume b5598897-d057-4d37-a00d-0c83f1a913ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5598897-d057-4d37-a00d-0c83f1a913ff', 'volume_size': 1, 'snapshot_id': 'd461c20f-4605-4b88-8fcb-8c195dc651f4'} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4-b5598897-d057-4d37-a00d-0c83f1a913ff" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4-b5598897-d057-4d37-a00d-0c83f1a913ff" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Creating volume b5598897-d057-4d37-a00d-0c83f1a913ff from snapshot d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] snapshot: d461c20f-4605-4b88-8fcb-8c195dc651f4, volume: b5598897-d057-4d37-a00d-0c83f1a913ff, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50218dc-c6d0-4583-8247-62963376b3d8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:14 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:14 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:14 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c2715-ae20-4f73-b357-14c44197ff79]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:14 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:14 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:15 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 0.780s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:15 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:09:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:15 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff Apr 30 11:09:15 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:20 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff" returned: 0 in 5.363s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c963b17-7975-480f-904b-08f996b73d82]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:21 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:21 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:22 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 1.168s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:09:22 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Converted 1024.00 MB image at 190.91 MB/s Apr 30 11:09:22 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff is being set with open permissions: ugo+rw Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:22 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff Apr 30 11:09:22 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:22 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" released by "_copy_volume_from_snapshot" :: held 9.082s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4-b5598897-d057-4d37-a00d-0c83f1a913ff" released by "_create_volume_from_snapshot" :: held 9.133s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.160s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e56d7ec-703e-468b-9f71-de4d9c9edfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5598897-d057-4d37-a00d-0c83f1a913ff', 'volume_size': 1, 'snapshot_id': 'd461c20f-4605-4b88-8fcb-8c195dc651f4'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fab3ca8-78a3-4d34-bbc9-7303a33d42b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:22 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Volume volume-b5598897-d057-4d37-a00d-0c83f1a913ff (b5598897-d057-4d37-a00d-0c83f1a913ff): created successfully Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fab3ca8-78a3-4d34-bbc9-7303a33d42b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (4f6a52a9-0ceb-4d12-bae7-3bd155242416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:22 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e4856483-edd6-48de-a86a-866a5abfb482 tempest-VolumeDependencyTests-1970605660 None] Created volume successfully. Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-d461c20f-4605-4b88-8fcb-8c195dc651f4-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-d461c20f-4605-4b88-8fcb-8c195dc651f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Deleting offline snapshot d461c20f-4605-4b88-8fcb-8c195dc651f4 of volume 732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] snapshot_file for this snap is: volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b952e-d510-4d3d-adaf-311feb90cefe]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:23 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:23 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:24 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.723s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d702ec-accc-4563-8daa-e424a0e2da40]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:24 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:24 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:25 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:25 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:25 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:25 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.706s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:25 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4 Apr 30 11:09:25 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:26 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633.d461c20f-4605-4b88-8fcb-8c195dc651f4" returned: 0 in 0.568s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-d461c20f-4605-4b88-8fcb-8c195dc651f4" released by "_delete_snapshot" :: held 2.844s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" released by "delete_snapshot" :: held 2.866s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Created reservations ['74bedba0-611e-4512-8336-8d6cfbb51909', 'f9624176-2424-487e-a8e3-fef3de697c10', '609353cc-21ff-4d5d-8089-473a4acd2514', '7e3a4a67-404f-46df-8ae7-65af714fe6b1'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:26 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Delete snapshot completed successfully. Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-83d713ba-88d4-4165-b02b-33da845efb66 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-d461c20f-4605-4b88-8fcb-8c195dc651f4-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-732486d4-a8cc-4eaf-a95b-4a59e8f65633-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-732486d4-a8cc-4eaf-a95b-4a59e8f65633-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:26 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:27 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2753e793-f2b0-488a-bc6d-60c79317d699]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:27 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:27 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:28 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 1.084s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:28 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633 Apr 30 11:09:28 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:28 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732486d4-a8cc-4eaf-a95b-4a59e8f65633" returned: 0 in 0.884s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-732486d4-a8cc-4eaf-a95b-4a59e8f65633" released by "delete_volume" :: held 2.041s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Created reservations ['2d57d4b6-1f86-42d9-bb3b-36b2263f6fdb', '878bd1f9-7399-444e-b5a1-f1d99608aef0', 'a3b5e6d7-a3f2-4df9-b7d7-e08557585f18', 'd6661c34-c02d-41fa-b157-a7ff245af440'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:29 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:29 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:29 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (96414e4c-d805-424e-a57b-502bcb36ad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73e63f6-72af-4ae9-adf6-18c5750a87eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73e63f6-72af-4ae9-adf6-18c5750a87eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-588763387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d996ac0-68a6-4343-b188-45848e29fe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:30Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ddc4e-3719-4bb6-a0da-e3f800139db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ddc4e-3719-4bb6-a0da-e3f800139db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffa06d4-571c-4b6a-96fc-d663f1ccc82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffa06d4-571c-4b6a-96fc-d663f1ccc82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d996ac0-68a6-4343-b188-45848e29fe9e', 'volume_name': 'volume-7d996ac0-68a6-4343-b188-45848e29fe9e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef0c89-167b-43de-89c2-da00f51207ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef0c89-167b-43de-89c2-da00f51207ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c810d501-9789-4182-8654-007fafbb3744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:30 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Volume 7d996ac0-68a6-4343-b188-45848e29fe9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d996ac0-68a6-4343-b188-45848e29fe9e', 'volume_size': 1} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-588763387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d996ac0-68a6-4343-b188-45848e29fe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:30Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Creating volume 7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:30 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:30 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e 1073741824 Apr 30 11:09:30 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:30 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.065s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Deleted volume successfully. Apr 30 11:09:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-cdb00a42-3145-4cdb-aa67-32e5bee1f8fa tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-732486d4-a8cc-4eaf-a95b-4a59e8f65633-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:31 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e 1073741824" returned: 0 in 0.926s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:31 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:31 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:31 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.661s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c810d501-9789-4182-8654-007fafbb3744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d996ac0-68a6-4343-b188-45848e29fe9e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43663384-aa8d-4cda-bcef-f2e17ecf1ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:31 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Volume volume-7d996ac0-68a6-4343-b188-45848e29fe9e (7d996ac0-68a6-4343-b188-45848e29fe9e): created successfully Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43663384-aa8d-4cda-bcef-f2e17ecf1ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (96414e4c-d805-424e-a57b-502bcb36ad6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:31 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=74,cinder:UPDATE=85,cinder:INSERT=19,cinder:DELETE=6 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:09:31 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-dfacff46-1179-4814-a120-8c22263dad1a tempest-VolumeDependencyTests-1970605660 None] Created volume successfully. Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (911bcb7a-a64f-41cb-854f-c43cf6e6490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b5d056-697c-478a-8423-0b602e5c3ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b5d056-697c-478a-8423-0b602e5c3ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-926631818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193aad4b-c614-454c-b30e-8817d6466233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32b0aac7cc549ed969c565453d652a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7d996ac0-68a6-4343-b188-45848e29fe9e,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:33Z,use_quota=True,user_id='1055b3bf901744288cc63699376ba2da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f3f40-0dad-4646-b628-07891edc4d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f3f40-0dad-4646-b628-07891edc4d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c948342-736d-4d29-a484-da2eea11addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=107,cinder:SELECT=84,cinder:DELETE=12,cinder:INSERT=23 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c948342-736d-4d29-a484-da2eea11addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '193aad4b-c614-454c-b30e-8817d6466233', 'volume_name': 'volume-193aad4b-c614-454c-b30e-8817d6466233', 'volume_size': 1, 'source_volid': '7d996ac0-68a6-4343-b188-45848e29fe9e', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cab5c3-6471-4672-b22b-32f840069e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cab5c3-6471-4672-b22b-32f840069e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc250bea-92bd-4af6-ad78-0594d4e8a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Volume 193aad4b-c614-454c-b30e-8817d6466233: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-193aad4b-c614-454c-b30e-8817d6466233', 'volume_size': 1, 'source_volid': '7d996ac0-68a6-4343-b188-45848e29fe9e', 'source_volstatus': 'available'} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:32 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Cloning volume 7d996ac0-68a6-4343-b188-45848e29fe9e to volume 193aad4b-c614-454c-b30e-8817d6466233 Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Creating offline snapshot 3d394f49-82af-42ec-b6c5-42be70ee6868 of volume 7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc218c-151e-4560-a0d5-2f99587f6e5f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:32 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:32 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:33 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:33 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 1G Apr 30 11:09:33 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:34 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 1G" returned: 0 in 0.786s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d996ac0-68a6-4343-b188-45848e29fe9e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:34 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d996ac0-68a6-4343-b188-45848e29fe9e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:34 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:34 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d996ac0-68a6-4343-b188-45848e29fe9e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:34 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 is being set with open permissions: ugo+rw Apr 30 11:09:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:34 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:34 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:35 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.574s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:35 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info Apr 30 11:09:35 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:36 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info" returned: 0 in 0.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:36 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info is being set with open permissions: ugo+rw Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:36 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info Apr 30 11:09:36 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:36 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.info" returned: 0 in 0.582s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] snapshot: 3d394f49-82af-42ec-b6c5-42be70ee6868, volume: 193aad4b-c614-454c-b30e-8817d6466233, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dad88a-c498-4bba-a6c8-238feeaa46f0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:36 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:36 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:37 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.772s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d996ac0-68a6-4343-b188-45848e29fe9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1f3879-6909-48d2-bc4f-f22c3ee4eb7b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:37 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:37 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:38 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.778s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:38 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:09:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:38 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 Apr 30 11:09:38 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:43 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233" returned: 0 in 4.974s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278b9d7-1048-4b9c-b288-ffa3049e527a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:43 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:43 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:44 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.846s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:09:44 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Converted 1024.00 MB image at 205.84 MB/s Apr 30 11:09:44 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 is being set with open permissions: ugo+rw Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:44 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 Apr 30 11:09:44 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:44 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233" returned: 0 in 0.610s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" released by "_copy_volume_from_snapshot" :: held 8.056s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-3d394f49-82af-42ec-b6c5-42be70ee6868" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-3d394f49-82af-42ec-b6c5-42be70ee6868" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Deleting offline snapshot 3d394f49-82af-42ec-b6c5-42be70ee6868 of volume 7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] snapshot_file for this snap is: volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fee8d64-aa64-4c09-b744-f44d123031f6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:45 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:45 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:45 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=6,cinder:INSERT=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:09:45 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.731s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d996ac0-68a6-4343-b188-45848e29fe9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5af241-4b8a-491c-96ea-4995e11b68e2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:45 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:45 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:46 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.685s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:46 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:46 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:47 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.673s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:47 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868 Apr 30 11:09:47 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:47 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e.3d394f49-82af-42ec-b6c5-42be70ee6868" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-3d394f49-82af-42ec-b6c5-42be70ee6868" released by "_delete_snapshot" :: held 2.787s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.987s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc250bea-92bd-4af6-ad78-0594d4e8a6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193aad4b-c614-454c-b30e-8817d6466233', 'volume_size': 1, 'source_volid': '7d996ac0-68a6-4343-b188-45848e29fe9e', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeb745c-14c1-4500-99e1-5d9ca08d6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Volume volume-193aad4b-c614-454c-b30e-8817d6466233 (193aad4b-c614-454c-b30e-8817d6466233): created successfully Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeb745c-14c1-4500-99e1-5d9ca08d6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Flow 'volume_create_manager' (911bcb7a-a64f-41cb-854f-c43cf6e6490c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e234ccad-74b8-4cf4-96f6-d5ccb8f64b25 tempest-VolumeDependencyTests-1970605660 None] Created volume successfully. Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-7d996ac0-68a6-4343-b188-45848e29fe9e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-7d996ac0-68a6-4343-b188-45848e29fe9e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-7d996ac0-68a6-4343-b188-45848e29fe9e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-7d996ac0-68a6-4343-b188-45848e29fe9e" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcf36c-4645-4a6c-9af0-8f9c1e25f823]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:49 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:49 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:49 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.677s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:49 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e Apr 30 11:09:49 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:50 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7d996ac0-68a6-4343-b188-45848e29fe9e" returned: 0 in 0.592s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-7d996ac0-68a6-4343-b188-45848e29fe9e" released by "delete_volume" :: held 1.333s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Created reservations ['fb2cc96a-316c-40fd-826c-1eee08fef650', '72c32141-a073-4af7-aba2-5fce00084fcc', '919477ad-cf37-4a73-83e6-deab02038f56', 'e978f7cf-ddab-4670-b5bd-28914b20043c'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:50 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:50 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:51 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.703s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Deleted volume successfully. Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ec2f3b15-72e6-4cd2-a351-39a2d40b3851 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-7d996ac0-68a6-4343-b188-45848e29fe9e-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-193aad4b-c614-454c-b30e-8817d6466233-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-193aad4b-c614-454c-b30e-8817d6466233-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee4254c-c087-4d3f-b881-70cc4c2892ea]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:51 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 Apr 30 11:09:51 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:52 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:52 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233 Apr 30 11:09:52 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:09:52 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (d1e93fef-4bcb-4a83-a952-84df186e9bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065bab1c-2be9-4f5a-ae64-c8a90cdfb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-193aad4b-c614-454c-b30e-8817d6466233" returned: 0 in 0.870s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065bab1c-2be9-4f5a-ae64-c8a90cdfb41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-563044143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a1c697-6f8f-4401-9db3-a14cc52141ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:53Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f4cf6e-5945-4932-a15b-d934017ea4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f4cf6e-5945-4932-a15b-d934017ea4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ee5986-9919-43d6-bb35-d4cf9b8b0169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ee5986-9919-43d6-bb35-d4cf9b8b0169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a1c697-6f8f-4401-9db3-a14cc52141ed', 'volume_name': 'volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b65b611-30dd-438e-9ac9-e44640e1557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b65b611-30dd-438e-9ac9-e44640e1557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7cadfb-154a-4aef-8037-9b453e0819af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Volume a4a1c697-6f8f-4401-9db3-a14cc52141ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed', 'volume_size': 1} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-563044143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a1c697-6f8f-4401-9db3-a14cc52141ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da334437b6041cda7583c4779827b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:53Z,use_quota=True,user_id='d1d5e7b070be45669c29b8ea95780791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Creating volume a4a1c697-6f8f-4401-9db3-a14cc52141ed {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-193aad4b-c614-454c-b30e-8817d6466233" released by "delete_volume" :: held 1.735s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:53 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed 1073741824 Apr 30 11:09:53 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Created reservations ['802b89b7-c96a-48dd-8673-50a35a384a32', '0f92c0d4-ab18-4d91-a3cf-d8986fce2d3d', '50a97896-80a4-416d-a3b1-176c568e443c', '645252fc-0f62-4843-af40-8d214749a74f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:53 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:53 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-b5598897-d057-4d37-a00d-0c83f1a913ff-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-b5598897-d057-4d37-a00d-0c83f1a913ff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[964de676-83e1-4a91-85ae-7f6ab17dc63d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:53 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff Apr 30 11:09:53 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:53 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.734s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Deleted volume successfully. Apr 30 11:09:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-07d3bac0-e5b8-47b6-b998-8d3fdbafbf1f tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-193aad4b-c614-454c-b30e-8817d6466233-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:54 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed 1073741824" returned: 0 in 1.037s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:54 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed Apr 30 11:09:54 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:54 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff" returned: 0 in 0.896s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:54 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff Apr 30 11:09:54 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:54 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7cadfb-154a-4aef-8037-9b453e0819af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db0e3f-b713-4a52-92d2-f196ccc63df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Volume volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed (a4a1c697-6f8f-4401-9db3-a14cc52141ed): created successfully Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db0e3f-b713-4a52-92d2-f196ccc63df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Flow 'volume_create_manager' (d1e93fef-4bcb-4a83-a952-84df186e9bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c0833b01-7010-414b-948d-44051b1d7622 tempest-AttachVolumeNegativeTest-51541391 None] Created volume successfully. Apr 30 11:09:55 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-b5598897-d057-4d37-a00d-0c83f1a913ff" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-quobyte-b5598897-d057-4d37-a00d-0c83f1a913ff" released by "delete_volume" :: held 1.555s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Created reservations ['5f878f9f-e784-49cb-9b17-5b1ea0a200d1', '87f91312-4eab-4462-9b18-91d4bec441d1', 'b7ef0b75-ed5e-4e25-8862-5feb3966cf50', '6cf0ae7a-29a0-4810-a9d5-696a564a002f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:55 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:55 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-289798d2-e225-4f2b-97bc-111c31b97ea1 tempest-TestShelveInstance-1787095224 None] Terminate volume connection completed successfully. Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-289798d2-e225-4f2b-97bc-111c31b97ea1 tempest-TestShelveInstance-1787095224 None] Deleting attachment 02ceea86-1ade-49a4-9dfb-8baeae101749. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:09:55 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.586s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Deleted volume successfully. Apr 30 11:09:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-138a9593-2c93-4696-b9e2-a494156f8825 tempest-VolumeDependencyTests-1970605660 None] Lock "cinder-b5598897-d057-4d37-a00d-0c83f1a913ff-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Acquiring lock "cinder-ed4cf0ba-b101-4080-84f8-50eea68d3ad6-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "cinder-ed4cf0ba-b101-4080-84f8-50eea68d3ad6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Acquiring lock "cinder-quobyte-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "cinder-quobyte-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f3e51-8804-4737-82f6-4973a68a2fb7]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:56 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:09:56 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:57 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.789s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:57 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:09:57 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:57 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 1 in 0.748s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:09:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:57 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6 Apr 30 11:09:57 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34493e-7622-4195-8b37-971bb8ec1b03]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:58 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed Apr 30 11:09:58 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:58 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" returned: 0 in 0.676s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "cinder-quobyte-ed4cf0ba-b101-4080-84f8-50eea68d3ad6" released by "delete_volume" :: held 2.289s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG cinder.quota [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Created reservations ['89c852a9-eaa4-41aa-896b-62a7795e68ca', '00711a29-d331-4685-b5e9-a45f2e724998', '4be6d43f-f2ec-4bdd-ae2f-5580c7a6acbc', '641eeaff-ab9c-4d10-8f79-2d73ac918c69'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:58 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:09:58 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:58 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed" returned: 0 in 0.812s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c53b003-4ca2-46d8-9b60-bd7a8c19f2af', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:09:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-70521da0-4039-41df-a48c-427da8431112 req-44413f50-838a-452d-8f87-d8bb029ee393 tempest-AttachVolumeNegativeTest-51541391 None] attachment_update completed successfully. Apr 30 11:09:59 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.693s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:59 devstack cinder-volume[84432]: DEBUG cinder.manager [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Deleted volume successfully. Apr 30 11:09:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [req-db4a7e2e-ea1d-4d9b-aa78-aa1aef3043a4 req-cd17d972-c7fd-4e2c-b414-fd1a899ac3bd tempest-TestShelveInstance-1787095224 None] Lock "cinder-ed4cf0ba-b101-4080-84f8-50eea68d3ad6-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Flow 'volume_create_manager' (2274be39-6c27-4538-aea5-65451a80a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a32fe3-8f01-4457-b08c-3f26bd09bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a32fe3-8f01-4457-b08c-3f26bd09bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48e1779-3f40-47af-9df6-efb653a1ff56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6900173063428885bd5a23ddcb78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:02Z,use_quota=True,user_id='a8358378238f4b8995116bfe76af2a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434b3fe3-6958-41b5-a45a-cd938de35c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434b3fe3-6958-41b5-a45a-cd938de35c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cac41e-7f1f-4048-a3ae-9191f4df0521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:01 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cac41e-7f1f-4048-a3ae-9191f4df0521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a48e1779-3f40-47af-9df6-efb653a1ff56', 'volume_name': 'volume-a48e1779-3f40-47af-9df6-efb653a1ff56', 'volume_size': 1, 'image_id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76f345a409d07c516b8a1d577cc73e17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e6900173063428885bd5a23ddcb78c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ff5f14596c32442bcced1348233a52ae26b3024fd7a587801bbdb0db59faf9fdc3ead4066c7c4cde48418c96a0991121a1e4a28f65aaaaad4c7bc6173ad814f', 'id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'created_at': datetime.datetime(2026, 4, 30, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d887a80-4e87-4a5c-aef1-734912671b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d887a80-4e87-4a5c-aef1-734912671b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8fd974-1ea3-4cc6-a67d-d748b8bdb447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Volume a48e1779-3f40-47af-9df6-efb653a1ff56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a48e1779-3f40-47af-9df6-efb653a1ff56', 'volume_size': 1, 'image_id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76f345a409d07c516b8a1d577cc73e17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e6900173063428885bd5a23ddcb78c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ff5f14596c32442bcced1348233a52ae26b3024fd7a587801bbdb0db59faf9fdc3ead4066c7c4cde48418c96a0991121a1e4a28f65aaaaad4c7bc6173ad814f', 'id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'created_at': datetime.datetime(2026, 4, 30, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f/file', 'properties': {}}, 'image_service': } Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Trying to clone a48e1779-3f40-47af-9df6-efb653a1ff56 from image cfc23c07-ad87-4cf4-b23c-3465038bc19f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:10:02 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Image download 0.00 MB at 0.00 MB/s Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8de60-c2e2-45d2-91f4-572e486886c2]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:02 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:02 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:02 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:02 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:03 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:03 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 1 in 0.823s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:03 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Temporary image cfc23c07-ad87-4cf4-b23c-3465038bc19f is fetched for user a8358378238f4b8995116bfe76af2a13. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:10:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0d93b-a884-45bf-8693-90d792f9cb26]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:03 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:03 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:04 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:04 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:04 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-bfd54ef8-e0b9-4913-9cb8-d67fb20c83e9 req-8b5bfe66-623c-4113-8a92-b9d4d194c089 tempest-AttachVolumeNegativeTest-51541391 None] Terminate volume connection completed successfully. Apr 30 11:10:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-bfd54ef8-e0b9-4913-9cb8-d67fb20c83e9 req-8b5bfe66-623c-4113-8a92-b9d4d194c089 tempest-AttachVolumeNegativeTest-51541391 None] Deleting attachment 7c53b003-4ca2-46d8-9b60-bd7a8c19f2af. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:10:05 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 1 in 0.744s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48e1779-3f40-47af-9df6-efb653a1ff56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6900173063428885bd5a23ddcb78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:02Z,use_quota=True,user_id='a8358378238f4b8995116bfe76af2a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Creating volume a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:05 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:10:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:05 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1073741824 Apr 30 11:10:05 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:06 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1073741824" returned: 0 in 0.833s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:06 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:06 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:06 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:06 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:06 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:06 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Attempting download of cfc23c07-ad87-4cf4-b23c-3465038bc19f ((None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}])) to volume a48e1779-3f40-47af-9df6-efb653a1ff56. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdbc467-e063-475e-b72e-4b010e17d418]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:07 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id Apr 30 11:10:07 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:07 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:07 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id Apr 30 11:10:07 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:08 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id" returned: 1 in 0.807s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfc23c07-ad87-4cf4-b23c-3465038bc19f_70pgt8id' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4217276-1e9b-4cec-9fe0-41303179d555]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:08 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:08 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:09 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:09 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD Apr 30 11:10:09 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:10 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD" returned: 1 in 0.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] cfc23c07-ad87-4cf4-b23c-3465038bc19f was raw, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:10 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:10 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:10 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 0 in 0.778s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfc23c07-ad87-4cf4-b23c-3465038bc19f_8t2j7y56devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:10:10 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Converted 0.00 MB image at 0.00 MB/s Apr 30 11:10:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:11 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1G Apr 30 11:10:11 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:11 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 1G" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad85317-a40b-4342-ac88-1441f0e66a65]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:11 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:11 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:12 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 0 in 0.715s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:12 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:12 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:13 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 1 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Downloaded image cfc23c07-ad87-4cf4-b23c-3465038bc19f ((None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}])) to volume a48e1779-3f40-47af-9df6-efb653a1ff56 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Temporary image cfc23c07-ad87-4cf4-b23c-3465038bc19f for user a8358378238f4b8995116bfe76af2a13 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Marking volume a48e1779-3f40-47af-9df6-efb653a1ff56 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Copying metadata from image cfc23c07-ad87-4cf4-b23c-3465038bc19f to a48e1779-3f40-47af-9df6-efb653a1ff56. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Creating volume glance metadata for volume a48e1779-3f40-47af-9df6-efb653a1ff56 backed by image cfc23c07-ad87-4cf4-b23c-3465038bc19f with: {'image_id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '76f345a409d07c516b8a1d577cc73e17', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8fd974-1ea3-4cc6-a67d-d748b8bdb447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48e1779-3f40-47af-9df6-efb653a1ff56', 'volume_size': 1, 'image_id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '76f345a409d07c516b8a1d577cc73e17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e6900173063428885bd5a23ddcb78c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ff5f14596c32442bcced1348233a52ae26b3024fd7a587801bbdb0db59faf9fdc3ead4066c7c4cde48418c96a0991121a1e4a28f65aaaaad4c7bc6173ad814f', 'id': 'cfc23c07-ad87-4cf4-b23c-3465038bc19f', 'created_at': datetime.datetime(2026, 4, 30, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfc23c07-ad87-4cf4-b23c-3465038bc19f/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fff122a-8d38-4daf-bf5e-8a2afb289088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:13 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Volume volume-a48e1779-3f40-47af-9df6-efb653a1ff56 (a48e1779-3f40-47af-9df6-efb653a1ff56): created successfully Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fff122a-8d38-4daf-bf5e-8a2afb289088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Flow 'volume_create_manager' (2274be39-6c27-4538-aea5-65451a80a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6c3d3d52-e5da-4912-baf8-78cd59e90cb1 tempest-VolumeImageDependencyTests-875765263 None] Created volume successfully. Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Acquiring lock "cinder-a48e1779-3f40-47af-9df6-efb653a1ff56-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "cinder-a48e1779-3f40-47af-9df6-efb653a1ff56-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Acquiring lock "cinder-quobyte-a48e1779-3f40-47af-9df6-efb653a1ff56" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "cinder-quobyte-a48e1779-3f40-47af-9df6-efb653a1ff56" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75efc87-d864-4e01-b9d8-602de36e0afe]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:14 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:14 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:15 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 0 in 0.746s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:15 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:15 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-a4a1c697-6f8f-4401-9db3-a14cc52141ed-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-a4a1c697-6f8f-4401-9db3-a14cc52141ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-quobyte-a4a1c697-6f8f-4401-9db3-a14cc52141ed" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-a4a1c697-6f8f-4401-9db3-a14cc52141ed" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:15 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8bcc8-f6a8-4c92-862c-132dfc85ec64]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:16 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed Apr 30 11:10:16 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:16 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 1 in 0.836s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:16 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56 Apr 30 11:10:16 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:16 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:16 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed Apr 30 11:10:16 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:17 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a48e1779-3f40-47af-9df6-efb653a1ff56" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "cinder-quobyte-a48e1779-3f40-47af-9df6-efb653a1ff56" released by "delete_volume" :: held 2.395s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Created reservations ['f9eec46d-9466-461b-876e-ae4038a9f3fa', 'a98d8c55-eb46-4191-9532-38f85accf633', '93bafa77-7943-4ea2-a04d-75ca263dffa6', 'dd181835-1f9a-4a7c-92cc-1b9254d1bdc8'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:17 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:17 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:17 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-a4a1c697-6f8f-4401-9db3-a14cc52141ed" returned: 0 in 0.871s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-a4a1c697-6f8f-4401-9db3-a14cc52141ed" released by "delete_volume" :: held 1.701s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Created reservations ['14078c8e-a017-498a-be18-aa60062aa59b', '15545b94-84cf-41e0-9d56-674eabeef625', 'd3373982-79c3-44ff-be9b-50337d1317f7', '3d705ffb-3c17-4a68-990f-70e95d87a5c3'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:17 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:17 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:18 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.825s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Deleted volume successfully. Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55b90269-3309-46e7-9f7b-f905743b2a74 tempest-VolumeImageDependencyTests-875765263 None] Lock "cinder-a48e1779-3f40-47af-9df6-efb653a1ff56-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-732e9b1e-a1bf-44d7-9df8-ebf82d06525f-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-732e9b1e-a1bf-44d7-9df8-ebf82d06525f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-quobyte-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd488791-7be2-42f9-a290-d78dfe62a199]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:18 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Deleted volume successfully. Apr 30 11:10:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f2a9e109-0ef3-421c-a981-17ec9701fe90 tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-a4a1c697-6f8f-4401-9db3-a14cc52141ed-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:18 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f Apr 30 11:10:18 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:19 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" returned: 0 in 0.782s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:19 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f Apr 30 11:10:19 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:20 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" returned: 0 in 0.654s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-732e9b1e-a1bf-44d7-9df8-ebf82d06525f" released by "delete_volume" :: held 1.505s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Created reservations ['4dcae896-f555-447e-8a01-6b1a05e8fc1d', 'c2773811-5d5b-4b66-a5f9-605a8afb5f41', 'c0748494-1a8f-445e-bd3c-0151d3dfc5f5', '1b742232-55a8-4cc6-b7ae-f5b491622e00'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:20 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:20 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-3563bcfd-2515-4794-b1bc-c566e131a497-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-3563bcfd-2515-4794-b1bc-c566e131a497-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:20 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Deleted volume successfully. Apr 30 11:10:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "cinder-quobyte-3563bcfd-2515-4794-b1bc-c566e131a497" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-3563bcfd-2515-4794-b1bc-c566e131a497" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-08fc6612-80dd-48f9-8a11-bd8daf4e879d tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-732e9b1e-a1bf-44d7-9df8-ebf82d06525f-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b72d58-5bc9-4446-9b52-ddb9d8afed88]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:21 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 Apr 30 11:10:21 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:21 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497" returned: 0 in 0.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:21 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497 Apr 30 11:10:21 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:22 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3563bcfd-2515-4794-b1bc-c566e131a497" returned: 0 in 0.614s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-quobyte-3563bcfd-2515-4794-b1bc-c566e131a497" released by "delete_volume" :: held 1.353s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Created reservations ['6f14a900-b5d1-4c0c-affd-ca82323b4ed7', '97d88a6e-b986-421e-b57c-786e5b8f5b04', 'f7136a38-280f-49ab-b771-f013d82eb2d0', 'cd861117-08d9-4ddd-85f5-8cc1811b9a9e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:22 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:22 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:23 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.669s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:23 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Deleted volume successfully. Apr 30 11:10:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-06c55e81-6baf-4843-ad7d-7a6442be533b tempest-AttachVolumeNegativeTest-51541391 None] Lock "cinder-3563bcfd-2515-4794-b1bc-c566e131a497-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1d2058df-0ee3-4577-b443-8a110d1eb157 tempest-GroupsV314Test-335670063 None] Group tempest-GroupsV314Test-Group-1010457997: creating Apr 30 11:10:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1d2058df-0ee3-4577-b443-8a110d1eb157 tempest-GroupsV314Test-335670063 None] Group tempest-GroupsV314Test-Group-1010457997: created successfully Apr 30 11:10:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1d2058df-0ee3-4577-b443-8a110d1eb157 tempest-GroupsV314Test-335670063 None] Create group completed successfully. Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Flow 'volume_create_manager' (a30bd9b9-8530-47f1-a6c5-af5bad7e8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5b01da-8930-4fb7-bc61-3966c3dcc044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5b01da-8930-4fb7-bc61-3966c3dcc044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029168995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6b65796-6c15-4b46-bac2-8b2604dc9ba3,host='devstack@QuobyteHD#QuobyteHD',id=70413046-611e-4e66-8915-f7a28cef7c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e1c6f9d8924c73a52f5c6d94872073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:32Z,use_quota=True,user_id='3488e08ad84741058fef1a59f1dd6673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ad982de-ba2a-4103-b6ff-2f26b4093f3f),volume_type_id=6ad982de-ba2a-4103-b6ff-2f26b4093f3f)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2ea98-1227-4ccd-8af9-39a661e3ac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2ea98-1227-4ccd-8af9-39a661e3ac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e79706-3315-4b97-ba08-e14685c4c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e79706-3315-4b97-ba08-e14685c4c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70413046-611e-4e66-8915-f7a28cef7c29', 'volume_name': 'volume-70413046-611e-4e66-8915-f7a28cef7c29', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea33eb3e-399c-4d7f-acba-d5cf0f76c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea33eb3e-399c-4d7f-acba-d5cf0f76c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75962fbd-2ace-4b7b-8519-a22254d74004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Volume 70413046-611e-4e66-8915-f7a28cef7c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70413046-611e-4e66-8915-f7a28cef7c29', 'volume_size': 1} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6b65796-6c15-4b46-bac2-8b2604dc9ba3,created_at=2026-04-30T09:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029168995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6b65796-6c15-4b46-bac2-8b2604dc9ba3,host='devstack@QuobyteHD#QuobyteHD',id=70413046-611e-4e66-8915-f7a28cef7c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e1c6f9d8924c73a52f5c6d94872073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:32Z,use_quota=True,user_id='3488e08ad84741058fef1a59f1dd6673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ad982de-ba2a-4103-b6ff-2f26b4093f3f),volume_type_id=6ad982de-ba2a-4103-b6ff-2f26b4093f3f)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Creating volume 70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:32 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:10:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:32 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 1073741824 Apr 30 11:10:32 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:33 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 1073741824" returned: 0 in 0.827s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:33 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=92,cinder:INSERT=21,cinder:DELETE=8,cinder:SELECT=54 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:10:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:33 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:33 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:34 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.612s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75962fbd-2ace-4b7b-8519-a22254d74004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70413046-611e-4e66-8915-f7a28cef7c29', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021b563d-ff0c-4221-8ad0-45950339ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Volume volume-70413046-611e-4e66-8915-f7a28cef7c29 (70413046-611e-4e66-8915-f7a28cef7c29): created successfully Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021b563d-ff0c-4221-8ad0-45950339ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Flow 'volume_create_manager' (a30bd9b9-8530-47f1-a6c5-af5bad7e8c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-13a1cdea-6273-4cbd-8dd9-21e06f6a7f86 tempest-GroupsV314Test-335670063 None] Created volume successfully. Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Flow 'volume_create_manager' (1bce0289-9b85-4657-b909-d3a4d817f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed69153d-ffeb-4a68-8d63-9d5502b4eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed69153d-ffeb-4a68-8d63-9d5502b4eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1390014847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b302b54-c988-46b4-9c03-9cc90352c9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce8c0b5099344dbab1299cd5ed51bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:35Z,use_quota=True,user_id='aa6bfd0b811b430cba79829f2dbbefed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a82722-38d4-413f-87b1-a68fdc66dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a82722-38d4-413f-87b1-a68fdc66dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9451946-6cf2-423f-8fd4-1a4d79cfb960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9451946-6cf2-423f-8fd4-1a4d79cfb960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b302b54-c988-46b4-9c03-9cc90352c9e4', 'volume_name': 'volume-6b302b54-c988-46b4-9c03-9cc90352c9e4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af46eba7-76aa-4804-b75a-2bb5813abb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af46eba7-76aa-4804-b75a-2bb5813abb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749582d6-7f15-4360-a44c-ec521623d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:35 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Volume 6b302b54-c988-46b4-9c03-9cc90352c9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b302b54-c988-46b4-9c03-9cc90352c9e4', 'volume_size': 1} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1390014847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b302b54-c988-46b4-9c03-9cc90352c9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce8c0b5099344dbab1299cd5ed51bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:35Z,use_quota=True,user_id='aa6bfd0b811b430cba79829f2dbbefed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Creating volume 6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:35 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:35 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 1073741824 Apr 30 11:10:35 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:36 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 1073741824" returned: 0 in 0.951s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:36 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:10:36 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:36 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.571s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.914s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:36 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Cloning volume 70413046-611e-4e66-8915-f7a28cef7c29 to volume 714f0dc1-857e-4da6-9f5d-7f661b5c1dfc Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749582d6-7f15-4360-a44c-ec521623d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b302b54-c988-46b4-9c03-9cc90352c9e4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd27cb7-c086-4dbb-8c87-3cf924e98917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Volume volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 (6b302b54-c988-46b4-9c03-9cc90352c9e4): created successfully Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd27cb7-c086-4dbb-8c87-3cf924e98917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Flow 'volume_create_manager' (1bce0289-9b85-4657-b909-d3a4d817f269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Creating offline snapshot 116e4065-a5c3-4316-8c7f-5f7e09fbfff5 of volume 70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:10:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d273387d-938d-4633-a4c6-2c4f3836e33b tempest-TestStampPattern-81916239 None] Created volume successfully. Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59afb0-ad6c-4a1f-a6c9-4f41b3aa90ab]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:36 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:36 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:37 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:37 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 1G Apr 30 11:10:37 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:38 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 1G" returned: 0 in 0.789s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70413046-611e-4e66-8915-f7a28cef7c29 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:38 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70413046-611e-4e66-8915-f7a28cef7c29 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:38 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:38 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70413046-611e-4e66-8915-f7a28cef7c29 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.622s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:38 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:10:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:38 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:38 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:39 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.562s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:39 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info Apr 30 11:10:39 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:40 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info" returned: 0 in 0.563s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:40 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:40 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info Apr 30 11:10:40 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:40 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.info" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Acquiring lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] snapshot: 116e4065-a5c3-4316-8c7f-5f7e09fbfff5, volume: 714f0dc1-857e-4da6-9f5d-7f661b5c1dfc, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf10d94-87b3-40d2-8d21-f83d96165559]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:40 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:40 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:41 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.805s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70413046-611e-4e66-8915-f7a28cef7c29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f1fb66-b001-48aa-a221-a32d61bfe180]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:41 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:41 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:42 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.773s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:42 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:10:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:42 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc Apr 30 11:10:42 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:46 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" returned: 0 in 4.614s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2942c218-e6d1-48f3-b480-4a6c3ed9ca3c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:47 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:47 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:47 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.817s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:47 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:10:47 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Converted 1024.00 MB image at 221.87 MB/s Apr 30 11:10:47 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:10:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:47 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc Apr 30 11:10:47 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:48 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" returned: 0 in 0.902s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" released by "_copy_volume_from_snapshot" :: held 8.011s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Acquiring lock "cinder-quobyte-116e4065-a5c3-4316-8c7f-5f7e09fbfff5" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-116e4065-a5c3-4316-8c7f-5f7e09fbfff5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Deleting offline snapshot 116e4065-a5c3-4316-8c7f-5f7e09fbfff5 of volume 70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] snapshot_file for this snap is: volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43b18b-f357-4791-9e1f-b84dbba7988d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:48 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:48 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:49 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.692s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70413046-611e-4e66-8915-f7a28cef7c29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:10:49 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=76,cinder:UPDATE=72,cinder:INSERT=26,cinder:DELETE=5 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:10:49 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ee0eb-0f40-4109-a81b-c5a8c3c9a91f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:49 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:49 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:50 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.750s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:50 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:50 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:51 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:51 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5 Apr 30 11:10:51 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:51 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29.116e4065-a5c3-4316-8c7f-5f7e09fbfff5" returned: 0 in 0.880s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-116e4065-a5c3-4316-8c7f-5f7e09fbfff5" released by "_delete_snapshot" :: held 3.205s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.268s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-92481bdc-7947-4e7b-aab8-c48a25e6b603 tempest-GroupsV314Test-335670063 None] Create group from source-group-c6b65796-6c15-4b46-bac2-8b2604dc9ba3 completed successfully. Apr 30 11:10:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Acquiring lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b373ebbe-132c-4708-8da5-67c2433c6df2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:53 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc Apr 30 11:10:53 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:54 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" returned: 0 in 0.981s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:54 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc Apr 30 11:10:54 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:55 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-714f0dc1-857e-4da6-9f5d-7f661b5c1dfc" released by "delete_volume" :: held 1.706s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Created reservations ['1d7d7dfa-ea26-4a88-9085-e76c95c401af'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:55 devstack cinder-volume[84432]: WARNING cinder.quota [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1721439770 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1721439770, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:10:55 devstack cinder-volume[84432]: WARNING cinder.quota [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1721439770 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1721439770, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Created reservations ['1d0faa3c-9ecf-4e0a-902a-af69e1e0d014', '130cb901-01f4-49cc-ad54-2ab5d64b0a08', 'eec3cdac-844e-4059-bd61-8aaf54d5f08a', '820aba17-8c11-4554-aafd-251f3472a0eb'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:55 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:55 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Acquiring lock "cinder-quobyte-70413046-611e-4e66-8915-f7a28cef7c29" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-70413046-611e-4e66-8915-f7a28cef7c29" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9ba54-64c4-4334-b2ad-e5c07454252b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:56 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:56 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:56 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.818s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:56 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-338ea090-ca29-42e2-8f38-05a06f6674c2 tempest-GroupsV314Test-335670063 None] Delete group completed successfully. Apr 30 11:10:56 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.857s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:56 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29 Apr 30 11:10:56 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:57 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-70413046-611e-4e66-8915-f7a28cef7c29" returned: 0 in 0.623s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Lock "cinder-quobyte-70413046-611e-4e66-8915-f7a28cef7c29" released by "delete_volume" :: held 1.563s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Created reservations ['a64941e1-37d4-4045-adc3-30175ac72a18'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Created reservations ['263142d8-1bd7-4b84-ab88-c4d8253f7de6', '04ac16d3-e9cc-43cb-87ee-a3891cd629e4', 'cf8a602a-d38a-4c1d-b3c6-202c1ce806f7', '2f8e6993-d47a-4808-b1fe-1c5cc8893a45'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:57 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:10:57 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:58 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.606s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:58 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:58 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fd55f3ea-8afe-4189-8a82-a8e89a3d33d2 tempest-GroupsV314Test-335670063 None] Delete group completed successfully. Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Flow 'volume_create_manager' (46876ae6-67bf-4649-a5b1-441d4eb07ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d1f36c-4635-464b-9b96-b90246044dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d1f36c-4635-464b-9b96-b90246044dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-301028583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b89a7e1-f72a-4906-a47c-a1ed563eaaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc53850d41f414a9e157039961fab86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:03Z,use_quota=True,user_id='4e7a7d7e853748abab8c1218b90a99be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a36c07-daa6-4a1f-a25f-e8861514165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a36c07-daa6-4a1f-a25f-e8861514165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a202cc-55bd-42f2-9516-96c97e625c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a202cc-55bd-42f2-9516-96c97e625c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b89a7e1-f72a-4906-a47c-a1ed563eaaf9', 'volume_name': 'volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a225db-40eb-48e0-9915-64d428ab5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a225db-40eb-48e0-9915-64d428ab5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c771f7a-6189-4a80-b908-a039c6e12265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:03 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Volume 5b89a7e1-f72a-4906-a47c-a1ed563eaaf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9', 'volume_size': 1} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-301028583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b89a7e1-f72a-4906-a47c-a1ed563eaaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc53850d41f414a9e157039961fab86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:03Z,use_quota=True,user_id='4e7a7d7e853748abab8c1218b90a99be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Creating volume 5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:03 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:11:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:03 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 1073741824 Apr 30 11:11:03 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:04 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 1073741824" returned: 0 in 0.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:04 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 Apr 30 11:11:04 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:04 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" returned: 0 in 0.575s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c771f7a-6189-4a80-b908-a039c6e12265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b900ddad-3ccb-4b69-a30a-3f0bddfbd9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Volume volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 (5b89a7e1-f72a-4906-a47c-a1ed563eaaf9): created successfully Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b900ddad-3ccb-4b69-a30a-3f0bddfbd9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Flow 'volume_create_manager' (46876ae6-67bf-4649-a5b1-441d4eb07ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-49427341-1006-4121-b7b8-3d81d89c2ff7 tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Created volume successfully. Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:06 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:11:06 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Acquiring lock "cinder-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "cinder-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Acquiring lock "cinder-quobyte-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "cinder-quobyte-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748282e-523f-427f-8b33-11d8918221bd]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:06 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 Apr 30 11:11:06 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:06 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.598s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:07 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:07 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9 Apr 30 11:11:07 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:07 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" returned: 0 in 0.594s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "cinder-quobyte-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9" released by "delete_volume" :: held 1.322s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Created reservations ['5befda39-5af6-49be-a4b0-7478e7eac403', '4bef711e-72d9-47c7-9bad-d439e1cbbc0d', '8e894f3c-f278-4460-9b5f-f2b5aa09f54c', 'c79aed36-a160-4661-b085-9bb5ace47efa'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:07 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:11:07 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:08 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.583s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:08 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Deleted volume successfully. Apr 30 11:11:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c2bbe4da-1f4d-46cd-85d7-66179d51ea9e tempest-VolumeQuotasNegativeTestJSON-2114134690 None] Lock "cinder-5b89a7e1-f72a-4906-a47c-a1ed563eaaf9-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Flow 'volume_create_manager' (5eab2743-5b69-4218-bd28-7ed47285713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2051dc2-d060-4475-af68-6f7e6b7d09f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2051dc2-d060-4475-af68-6f7e6b7d09f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1847527741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecfa341-7123-4242-a4c2-c97413c7c3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c43f84092e4dd2b0c24ea1c16c859d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:14Z,use_quota=True,user_id='d622fa36528c4f72be1e856a10e22eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9f65944-420b-4899-8a2e-5d9aabf388ef),volume_type_id=b9f65944-420b-4899-8a2e-5d9aabf388ef)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae286814-6ec1-4fbc-b3fc-48e121185508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae286814-6ec1-4fbc-b3fc-48e121185508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49314bae-7a78-46e5-a710-fe8b052c6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49314bae-7a78-46e5-a710-fe8b052c6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecfa341-7123-4242-a4c2-c97413c7c3a8', 'volume_name': 'volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfee911-b12e-4fa2-b163-d9c2e3f0e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfee911-b12e-4fa2-b163-d9c2e3f0e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77983c06-a730-4489-98ba-8ae404ba51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:14 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Volume 2ecfa341-7123-4242-a4c2-c97413c7c3a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8', 'volume_size': 1} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1847527741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecfa341-7123-4242-a4c2-c97413c7c3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c43f84092e4dd2b0c24ea1c16c859d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:14Z,use_quota=True,user_id='d622fa36528c4f72be1e856a10e22eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9f65944-420b-4899-8a2e-5d9aabf388ef),volume_type_id=b9f65944-420b-4899-8a2e-5d9aabf388ef)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Creating volume 2ecfa341-7123-4242-a4c2-c97413c7c3a8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:14 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:11:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:14 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 1073741824 Apr 30 11:11:14 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:15 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 1073741824" returned: 0 in 0.787s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:15 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 Apr 30 11:11:15 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:15 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8" returned: 0 in 0.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77983c06-a730-4489-98ba-8ae404ba51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb29c84-e386-48fb-94d9-c86faa7b3f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Volume volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 (2ecfa341-7123-4242-a4c2-c97413c7c3a8): created successfully Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb29c84-e386-48fb-94d9-c86faa7b3f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Flow 'volume_create_manager' (5eab2743-5b69-4218-bd28-7ed47285713d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ad870cd0-1791-4c18-b8a7-ff5c79343bdd tempest-VolumeTypesAccessTest-507219458 None] Created volume successfully. Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Acquiring lock "cinder-2ecfa341-7123-4242-a4c2-c97413c7c3a8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "cinder-2ecfa341-7123-4242-a4c2-c97413c7c3a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Acquiring lock "cinder-quobyte-2ecfa341-7123-4242-a4c2-c97413c7c3a8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "cinder-quobyte-2ecfa341-7123-4242-a4c2-c97413c7c3a8" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66e0e50-e950-4f4c-883a-27311ceb5d3a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:16 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 Apr 30 11:11:16 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:17 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8" returned: 0 in 0.723s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:17 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8 Apr 30 11:11:17 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbb1d7c-1082-4485-8f35-98227d43e657]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:17 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:11:17 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:17 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ecfa341-7123-4242-a4c2-c97413c7c3a8" returned: 0 in 0.581s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "cinder-quobyte-2ecfa341-7123-4242-a4c2-c97413c7c3a8" released by "delete_volume" :: held 1.352s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:17 devstack cinder-volume[84432]: WARNING cinder.quota [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1190178856 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1190178856, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:11:17 devstack cinder-volume[84432]: WARNING cinder.quota [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1190178856 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1190178856, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:11:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Created reservations ['40585b0c-ebd3-48cb-bd88-cb6e22d190fd', '316e027f-455e-447a-9b84-dafc6e7b3c9b', '6b4a8a3d-f979-429f-bd2d-f3033e64f2b0', 'c6988b13-58a4-4ed8-8fa3-0d6bf555ccb4'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:18 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:11:18 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:18 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-6b302b54-c988-46b4-9c03-9cc90352c9e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a97d90a-43d3-41c3-9afb-57a48284d885', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:11:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-ef3a3846-a96c-43b9-8e15-8dc1026e41cf req-91f61d11-e2a3-4d5f-9adc-0ce90fc2d0a2 tempest-TestStampPattern-81916239 None] attachment_update completed successfully. Apr 30 11:11:18 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.624s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Deleted volume successfully. Apr 30 11:11:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d63de8a5-cb7b-490b-b617-cf42608670a8 tempest-VolumeTypesAccessTest-507219458 None] Lock "cinder-2ecfa341-7123-4242-a4c2-c97413c7c3a8-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:26 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-1fefebb7-f911-41f4-9b8b-a2fd18cdb320 req-1b3679a1-b71c-4168-9302-d930993ed91f tempest-TestStampPattern-81916239 None] Terminate volume connection completed successfully. Apr 30 11:11:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-1fefebb7-f911-41f4-9b8b-a2fd18cdb320 req-1b3679a1-b71c-4168-9302-d930993ed91f tempest-TestStampPattern-81916239 None] Deleting attachment 1a97d90a-43d3-41c3-9afb-57a48284d885. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Creating offline snapshot a3873839-7888-49be-9955-d6efc6947aa4 of volume 6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e18969-577d-4f74-a6af-8fd11cf2ac49]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Flow 'volume_create_manager' (05e882ca-fac6-4f0e-a5f9-c10c4cc3f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45378ddd-690c-4eb3-8428-23c90828bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45378ddd-690c-4eb3-8428-23c90828bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2076101997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff42111-8557-408b-b457-de8c0c91ce8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698ba5231fc54e028897476db26e9163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:29Z,use_quota=True,user_id='19a1a64d4c3f4ae385aeb6fb2a4865e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b5739c-e09a-43ab-8940-becf5d229ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b5739c-e09a-43ab-8940-becf5d229ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef52f0ea-90fd-484f-83d0-2393d5e8bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef52f0ea-90fd-484f-83d0-2393d5e8bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff42111-8557-408b-b457-de8c0c91ce8e', 'volume_name': 'volume-6ff42111-8557-408b-b457-de8c0c91ce8e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9f9638-5ecb-42cd-863e-865c312eee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9f9638-5ecb-42cd-863e-865c312eee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311ca44b-ea4e-4ff9-9266-2300e2722542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Volume 6ff42111-8557-408b-b457-de8c0c91ce8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff42111-8557-408b-b457-de8c0c91ce8e', 'volume_size': 1} Apr 30 11:11:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:28 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:11:28 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:29 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.680s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:29 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 1G Apr 30 11:11:29 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:30 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 1G" returned: 0 in 0.742s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:30 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:11:30 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:30 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.663s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:30 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 is being set with open permissions: ugo+rw Apr 30 11:11:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:30 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:11:30 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:31 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.656s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:31 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info Apr 30 11:11:31 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:32 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info" returned: 0 in 0.581s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:32 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info is being set with open permissions: ugo+rw Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:32 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info Apr 30 11:11:32 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:32 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.info" returned: 0 in 0.571s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.978s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.857s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2076101997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff42111-8557-408b-b457-de8c0c91ce8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698ba5231fc54e028897476db26e9163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:29Z,use_quota=True,user_id='19a1a64d4c3f4ae385aeb6fb2a4865e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Creating volume 6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:32 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:11:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:32 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e 1073741824 Apr 30 11:11:32 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-711b1fd9-56f6-4bc3-83e3-e88cba580f60 tempest-TestStampPattern-81916239 None] Create snapshot completed successfully Apr 30 11:11:33 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e 1073741824" returned: 0 in 0.841s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:33 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=54,cinder:SELECT=60,cinder:INSERT=12,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:11:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:33 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e Apr 30 11:11:33 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:34 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e" returned: 0 in 0.602s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311ca44b-ea4e-4ff9-9266-2300e2722542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff42111-8557-408b-b457-de8c0c91ce8e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaae731-93c0-4e8d-8719-54f3d4b4ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Volume volume-6ff42111-8557-408b-b457-de8c0c91ce8e (6ff42111-8557-408b-b457-de8c0c91ce8e): created successfully Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaae731-93c0-4e8d-8719-54f3d4b4ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Flow 'volume_create_manager' (05e882ca-fac6-4f0e-a5f9-c10c4cc3f73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-795e5a0f-579f-47c4-b84b-b4cdb198f0b3 tempest-SnapshotMetadataTestJSON-2074091059 None] Created volume successfully. Apr 30 11:11:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Creating offline snapshot de6a466f-1f3e-4406-878c-dc992f7f4fb0 of volume 6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:11:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9b347-23f9-4eef-a0b0-fb6e98009f3c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:35 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e Apr 30 11:11:35 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:36 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e" returned: 0 in 0.713s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:36 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 1G Apr 30 11:11:36 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:36 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 1G" returned: 0 in 0.717s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff42111-8557-408b-b457-de8c0c91ce8e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:36 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff42111-8557-408b-b457-de8c0c91ce8e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 Apr 30 11:11:36 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:37 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff42111-8557-408b-b457-de8c0c91ce8e -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:37 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 is being set with open permissions: ugo+rw Apr 30 11:11:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:37 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 Apr 30 11:11:37 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:38 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0" returned: 0 in 0.612s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:38 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info Apr 30 11:11:38 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:38 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info" returned: 0 in 0.601s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:38 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info is being set with open permissions: ugo+rw Apr 30 11:11:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:38 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info Apr 30 11:11:38 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:39 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.info" returned: 0 in 0.615s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.019s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7c9affa1-d876-4221-89e3-4a88d9bcfbeb tempest-SnapshotMetadataTestJSON-2074091059 None] Create snapshot completed successfully Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "cinder-de6a466f-1f3e-4406-878c-dc992f7f4fb0-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-de6a466f-1f3e-4406-878c-dc992f7f4fb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "cinder-quobyte-de6a466f-1f3e-4406-878c-dc992f7f4fb0" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-de6a466f-1f3e-4406-878c-dc992f7f4fb0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Deleting offline snapshot de6a466f-1f3e-4406-878c-dc992f7f4fb0 of volume 6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] snapshot_file for this snap is: volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e9f613-a61d-42cb-b20e-e9130909d6e3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:40 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 Apr 30 11:11:40 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:41 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff42111-8557-408b-b457-de8c0c91ce8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e019e32-f9b2-41d3-90c5-a5a89025b7b1]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:41 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e Apr 30 11:11:41 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:41 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e" returned: 0 in 0.715s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:41 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 Apr 30 11:11:41 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:42 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0" returned: 0 in 0.687s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:42 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0 Apr 30 11:11:42 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Flow 'volume_create_manager' (bf46620b-78ec-4693-8ce3-b200ab4c818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2208f7d8-41bd-4edb-868e-635af1a19e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2208f7d8-41bd-4edb-868e-635af1a19e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-210085788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce8c0b5099344dbab1299cd5ed51bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3873839-7888-49be-9955-d6efc6947aa4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:43Z,use_quota=True,user_id='aa6bfd0b811b430cba79829f2dbbefed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677c3ea5-a7f0-4af0-a76d-5253e5a02824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677c3ea5-a7f0-4af0-a76d-5253e5a02824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99e2292-6d89-49dd-924a-90bd187bd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99e2292-6d89-49dd-924a-90bd187bd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8', 'volume_name': 'volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8', 'volume_size': 1, 'snapshot_id': 'a3873839-7888-49be-9955-d6efc6947aa4'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeee825-fa09-4207-b87e-8a97e9bad384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeee825-fa09-4207-b87e-8a97e9bad384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c51beb-5ed7-4f00-84c7-9f2f644703b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Volume 3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8', 'volume_size': 1, 'snapshot_id': 'a3873839-7888-49be-9955-d6efc6947aa4'} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Creating volume 3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 from snapshot a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] snapshot: a3873839-7888-49be-9955-d6efc6947aa4, volume: 3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[36932504-368b-4e02-88d0-11ff41b061d9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:43 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:11:43 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:43 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e.de6a466f-1f3e-4406-878c-dc992f7f4fb0" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-de6a466f-1f3e-4406-878c-dc992f7f4fb0" released by "_delete_snapshot" :: held 2.969s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" released by "delete_snapshot" :: held 2.993s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Created reservations ['3740f225-ebd4-4260-833d-f1971c95567e', 'bec0aebb-eab4-411e-ae1d-ecafa72f5202', '9dad5579-9e60-4e7d-a721-50ddb23dd90a', '570f463f-55b9-41db-ba36-fbde6fe3d057'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Delete snapshot completed successfully. Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6da31957-8d11-4bb9-ad3c-7fa393cac343 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-de6a466f-1f3e-4406-878c-dc992f7f4fb0-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "cinder-6ff42111-8557-408b-b457-de8c0c91ce8e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-6ff42111-8557-408b-b457-de8c0c91ce8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f09f5-f9ef-4f08-8903-b428a974acb7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:43 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.821s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b302b54-c988-46b4-9c03-9cc90352c9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a3560-80e5-422f-8c2f-b9efbce74898]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:43 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e Apr 30 11:11:43 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:43 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:11:43 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:44 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e" returned: 0 in 0.839s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:44 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e Apr 30 11:11:44 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:44 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.778s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:44 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:11:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:44 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 Apr 30 11:11:44 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:45 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6ff42111-8557-408b-b457-de8c0c91ce8e" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-quobyte-6ff42111-8557-408b-b457-de8c0c91ce8e" released by "delete_volume" :: held 1.524s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Created reservations ['ae546934-41a1-475b-8549-fa3f200198f6', '92a45ad9-269f-4a47-9ce4-19bd53c16976', 'ab258890-2850-4931-bdc5-0e80e5d30f3e', '32752d39-f4dc-4c3c-89eb-3dc6daea8b0f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:45 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:11:45 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:46 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.545s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:46 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Deleted volume successfully. Apr 30 11:11:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2bbdf293-0353-4b31-afe1-34aaeeac43e9 tempest-SnapshotMetadataTestJSON-2074091059 None] Lock "cinder-6ff42111-8557-408b-b457-de8c0c91ce8e-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:50 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" returned: 0 in 5.768s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2996ad66-52e3-4d13-98d8-46b4dc6dfe38]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:50 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:11:50 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:51 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 1.142s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:51 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:11:51 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Converted 1024.00 MB image at 177.49 MB/s Apr 30 11:11:51 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 is being set with open permissions: ugo+rw Apr 30 11:11:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:51 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 Apr 30 11:11:51 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=66,cinder:SELECT=60,cinder:INSERT=16,cinder:DELETE=5 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Flow 'volume_create_manager' (ebd137f4-7de9-4edf-8d66-29fba79d151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a01579-8d31-457a-8a24-562dcc785f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a01579-8d31-457a-8a24-562dcc785f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1465598120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd93d100-84c0-424c-88c7-78653e017f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3356b2d02a534afbb9e92013b53510d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:52Z,use_quota=True,user_id='143a410338554582b891f47bfedf1972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa5e768-2fcb-4807-9006-e2c59b6f28ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa5e768-2fcb-4807-9006-e2c59b6f28ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1055ae28-3cf9-4dc0-b6ea-75a7e63bbb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1055ae28-3cf9-4dc0-b6ea-75a7e63bbb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd93d100-84c0-424c-88c7-78653e017f2f', 'volume_name': 'volume-cd93d100-84c0-424c-88c7-78653e017f2f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821015d5-bdad-4a26-bbf6-d953be609ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821015d5-bdad-4a26-bbf6-d953be609ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7774ece9-202a-4e56-b17f-9a1aae13b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Volume cd93d100-84c0-424c-88c7-78653e017f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd93d100-84c0-424c-88c7-78653e017f2f', 'volume_size': 1} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:52 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" returned: 0 in 0.749s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" released by "_copy_volume_from_snapshot" :: held 9.370s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" released by "_create_volume_from_snapshot" :: held 9.407s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.425s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1465598120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd93d100-84c0-424c-88c7-78653e017f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3356b2d02a534afbb9e92013b53510d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:52Z,use_quota=True,user_id='143a410338554582b891f47bfedf1972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Creating volume cd93d100-84c0-424c-88c7-78653e017f2f {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:52 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f 1073741824 Apr 30 11:11:52 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c51beb-5ed7-4f00-84c7-9f2f644703b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8', 'volume_size': 1, 'snapshot_id': 'a3873839-7888-49be-9955-d6efc6947aa4'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67306be8-7f90-4a80-8c84-d610e42dce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Volume volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 (3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8): created successfully Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67306be8-7f90-4a80-8c84-d610e42dce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Flow 'volume_create_manager' (bf46620b-78ec-4693-8ce3-b200ab4c818a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-891fb2e8-cd33-4579-8810-8b490b52eaf6 tempest-TestStampPattern-81916239 None] Created volume successfully. Apr 30 11:11:53 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f 1073741824" returned: 0 in 0.965s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:53 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f Apr 30 11:11:53 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:53 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f" returned: 0 in 0.590s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7774ece9-202a-4e56-b17f-9a1aae13b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd93d100-84c0-424c-88c7-78653e017f2f', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69466eec-b829-4c44-8cec-4d8929d2d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:53 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Volume volume-cd93d100-84c0-424c-88c7-78653e017f2f (cd93d100-84c0-424c-88c7-78653e017f2f): created successfully Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69466eec-b829-4c44-8cec-4d8929d2d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Flow 'volume_create_manager' (ebd137f4-7de9-4edf-8d66-29fba79d151d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2cac8e69-bd0d-408f-a3ad-fc1b299c72a1 tempest-VolumesMetadataTest-1461509811 None] Created volume successfully. Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Acquiring lock "cinder-cd93d100-84c0-424c-88c7-78653e017f2f-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "cinder-cd93d100-84c0-424c-88c7-78653e017f2f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Acquiring lock "cinder-quobyte-cd93d100-84c0-424c-88c7-78653e017f2f" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "cinder-quobyte-cd93d100-84c0-424c-88c7-78653e017f2f" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[78547512-6a96-4f83-8463-eab8febfcddf]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:55 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f Apr 30 11:11:55 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:55 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:55 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f Apr 30 11:11:55 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:56 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cd93d100-84c0-424c-88c7-78653e017f2f" returned: 0 in 0.595s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "cinder-quobyte-cd93d100-84c0-424c-88c7-78653e017f2f" released by "delete_volume" :: held 1.328s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Created reservations ['66e6a828-6316-4a29-8aa8-7b5059cdc7b9', '473ab1d1-11e9-4b4e-944c-7794cb53c60a', '70c5297d-bec8-4cf0-9a98-49573dff7a08', 'a10b93f7-f0fc-42b7-a07e-d6206e2ee5ce'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:56 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:11:56 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:56 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.579s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Deleted volume successfully. Apr 30 11:11:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d9cc5632-abae-4d03-8051-8aa067adf51d tempest-VolumesMetadataTest-1461509811 None] Lock "cinder-cd93d100-84c0-424c-88c7-78653e017f2f-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:01 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Flow 'volume_create_manager' (a1844a73-1744-4859-a1ce-1fb3248b5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af404d9b-a6ea-4944-bbcb-2b937971547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af404d9b-a6ea-4944-bbcb-2b937971547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-550782774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82914f5-00bc-4e34-ac26-72a9a7b2a31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86e62625bce4d8ea7feef6d031995fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:02Z,use_quota=True,user_id='f484651d99fe49da92e7b520c48a7d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e35edbf-31d4-4e08-9fdd-1552adb60653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e35edbf-31d4-4e08-9fdd-1552adb60653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70cf7be8-4229-4d8c-b885-2857243be223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70cf7be8-4229-4d8c-b885-2857243be223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82914f5-00bc-4e34-ac26-72a9a7b2a31b', 'volume_name': 'volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0388ee2e-7e0c-4c0f-944c-3a79a8b51eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0388ee2e-7e0c-4c0f-944c-3a79a8b51eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26d3c9-a34c-47ca-a5a1-7f2f1ebeb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Volume c82914f5-00bc-4e34-ac26-72a9a7b2a31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b', 'volume_size': 1} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-550782774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82914f5-00bc-4e34-ac26-72a9a7b2a31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86e62625bce4d8ea7feef6d031995fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:02Z,use_quota=True,user_id='f484651d99fe49da92e7b520c48a7d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Creating volume c82914f5-00bc-4e34-ac26-72a9a7b2a31b {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:02 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:02 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b 1073741824 Apr 30 11:12:02 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:02 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b 1073741824" returned: 0 in 0.853s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:03 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b Apr 30 11:12:03 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:03 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" returned: 0 in 0.642s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb26d3c9-a34c-47ca-a5a1-7f2f1ebeb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422c2e46-ef60-4018-b454-2e9d6676c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:03 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Volume volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b (c82914f5-00bc-4e34-ac26-72a9a7b2a31b): created successfully Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422c2e46-ef60-4018-b454-2e9d6676c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:03 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Flow 'volume_create_manager' (a1844a73-1744-4859-a1ce-1fb3248b5572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:03 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-62103d6b-2b58-4f95-be30-667868743d47 tempest-VolumesTransfersV355Test-1501552786 None] Created volume successfully. Apr 30 11:12:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b16c20f9-f010-4918-ad93-4502180a39f6 tempest-VolumesTransfersV355Test-1452937207 None] Transfer volume completed successfully. Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "cinder-c82914f5-00bc-4e34-ac26-72a9a7b2a31b-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-c82914f5-00bc-4e34-ac26-72a9a7b2a31b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "cinder-quobyte-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-quobyte-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb08656-dc07-4267-9594-f42dcfae7a2c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:05 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b Apr 30 11:12:05 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:06 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:12:06 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:06 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:06 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b Apr 30 11:12:06 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:06 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:07 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-quobyte-c82914f5-00bc-4e34-ac26-72a9a7b2a31b" released by "delete_volume" :: held 1.409s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Created reservations ['b9d97732-e139-447d-a464-865972310748', 'c7062e88-ac8b-46fb-9b3b-a577f7403006', '9d7f919e-762d-4614-a303-41df1249658d', '205de767-5962-4b68-aca5-2404c31aaaaf'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:07 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:12:07 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:07 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.613s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Deleted volume successfully. Apr 30 11:12:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94d081c6-4c72-4f66-b86e-5bc3807708bb tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-c82914f5-00bc-4e34-ac26-72a9a7b2a31b-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Flow 'volume_create_manager' (7c9569ab-455a-466b-ba33-e43f688216de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a590b02e-573d-458f-8a33-024eb2ded9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a590b02e-573d-458f-8a33-024eb2ded9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-98458547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da611c-2b9e-4341-93b3-183263d898be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86e62625bce4d8ea7feef6d031995fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:08Z,use_quota=True,user_id='f484651d99fe49da92e7b520c48a7d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2770b0a7-0ff4-4c8a-87d8-ce9601c9ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2770b0a7-0ff4-4c8a-87d8-ce9601c9ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61478c95-e89d-4b77-945a-f42909e78bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61478c95-e89d-4b77-945a-f42909e78bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34da611c-2b9e-4341-93b3-183263d898be', 'volume_name': 'volume-34da611c-2b9e-4341-93b3-183263d898be', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2889b5fb-13ec-49b0-bea0-0eaea791a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2889b5fb-13ec-49b0-bea0-0eaea791a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cb0b20-d9a6-4664-8b67-f49c317f9023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Volume 34da611c-2b9e-4341-93b3-183263d898be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34da611c-2b9e-4341-93b3-183263d898be', 'volume_size': 1} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-98458547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da611c-2b9e-4341-93b3-183263d898be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86e62625bce4d8ea7feef6d031995fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:08Z,use_quota=True,user_id='f484651d99fe49da92e7b520c48a7d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Creating volume 34da611c-2b9e-4341-93b3-183263d898be {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:08 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:12:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:08 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be 1073741824 Apr 30 11:12:08 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:09 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be 1073741824" returned: 0 in 0.787s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:09 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be Apr 30 11:12:09 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:09 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be" returned: 0 in 0.572s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cb0b20-d9a6-4664-8b67-f49c317f9023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34da611c-2b9e-4341-93b3-183263d898be', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcff4e3-a5e9-40ab-8223-6fa4911c61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:09 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Volume volume-34da611c-2b9e-4341-93b3-183263d898be (34da611c-2b9e-4341-93b3-183263d898be): created successfully Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcff4e3-a5e9-40ab-8223-6fa4911c61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Flow 'volume_create_manager' (7c9569ab-455a-466b-ba33-e43f688216de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ae605592-7a44-44f0-9aa0-aa03c609c0ec tempest-VolumesTransfersV355Test-1501552786 None] Created volume successfully. Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "cinder-34da611c-2b9e-4341-93b3-183263d898be-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-34da611c-2b9e-4341-93b3-183263d898be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "cinder-quobyte-34da611c-2b9e-4341-93b3-183263d898be" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-quobyte-34da611c-2b9e-4341-93b3-183263d898be" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b4efeb-1290-4c43-b6d9-c7639fbc49ad]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:11 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be Apr 30 11:12:11 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:11 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be" returned: 0 in 0.712s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:11 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be Apr 30 11:12:11 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:12 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-34da611c-2b9e-4341-93b3-183263d898be" returned: 0 in 0.579s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-quobyte-34da611c-2b9e-4341-93b3-183263d898be" released by "delete_volume" :: held 1.332s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Created reservations ['f95b2c66-cd36-4f8d-bc75-db0e488120b5', '3aa2ff09-d5e3-4122-9a07-a91a223dd14e', 'ecdf67fc-12a9-4ec3-84c7-72408b44bb40', '88cf5e69-ca64-4f33-ba91-537ba99dc839'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:12 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:12:12 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:12 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Deleted volume successfully. Apr 30 11:12:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9733f4f6-78f9-40fa-aa2e-08916610519e tempest-VolumesTransfersV355Test-561049688 None] Lock "cinder-34da611c-2b9e-4341-93b3-183263d898be-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=55,cinder:SELECT=37,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:12:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=20,cinder:UPDATE=36,cinder:DELETE=6,cinder:INSERT=9 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Flow 'volume_create_manager' (b6047066-ba44-4259-ab8f-5518fd799b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b109e26a-07c2-46c3-8329-c58fb6b9dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b109e26a-07c2-46c3-8329-c58fb6b9dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223391176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac77294-d5e5-48f0-8b47-2ffa1b955025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c4be4db9cc441eae6148f0541f6269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:26Z,use_quota=True,user_id='fd564a2efd064df7827dabb072f9c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4169892e-4dfb-4432-94f6-0046c5a47a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4169892e-4dfb-4432-94f6-0046c5a47a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085b75d4-5355-455d-8aa8-250c0cc4b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085b75d4-5355-455d-8aa8-250c0cc4b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac77294-d5e5-48f0-8b47-2ffa1b955025', 'volume_name': 'volume-cac77294-d5e5-48f0-8b47-2ffa1b955025', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be5e8e0-7ea9-4786-93ac-08747a67f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be5e8e0-7ea9-4786-93ac-08747a67f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218777b8-80bc-45b6-a1c6-ab9bf463ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Volume cac77294-d5e5-48f0-8b47-2ffa1b955025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac77294-d5e5-48f0-8b47-2ffa1b955025', 'volume_size': 1} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223391176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac77294-d5e5-48f0-8b47-2ffa1b955025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c4be4db9cc441eae6148f0541f6269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:26Z,use_quota=True,user_id='fd564a2efd064df7827dabb072f9c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Creating volume cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:26 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:26 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 1073741824 Apr 30 11:12:26 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:26 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 1073741824" returned: 0 in 0.752s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:27 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:12:27 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:27 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218777b8-80bc-45b6-a1c6-ab9bf463ac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac77294-d5e5-48f0-8b47-2ffa1b955025', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47868072-441c-485c-aeed-438c08dd7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:27 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Volume volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 (cac77294-d5e5-48f0-8b47-2ffa1b955025): created successfully Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47868072-441c-485c-aeed-438c08dd7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:27 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Flow 'volume_create_manager' (b6047066-ba44-4259-ab8f-5518fd799b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:27 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-862bb6f9-76f3-44fc-aec5-76962f9de5fc tempest-VolumesActionsTest-233116984 None] Created volume successfully. Apr 30 11:12:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:28 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[44532b65-2fc8-4238-967d-1dae2352eced]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:28 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 Apr 30 11:12:28 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:29 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" returned: 0 in 0.729s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:29 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b85bc59f-e500-4059-a530-9b05dd7ebcb6', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:12:29 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-c9539db0-831b-4b99-a8e2-bcf60cf26629 req-5be52501-b4b4-4bad-8840-8ff60cdbbcba tempest-TestStampPattern-81916239 None] attachment_update completed successfully. Apr 30 11:12:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-fd599520-7b35-4c77-961e-17bdff1f50b4 req-c07cdd0c-d53a-42a8-8579-ad7aef91ef93 tempest-TestStampPattern-81916239 None] Terminate volume connection completed successfully. Apr 30 11:12:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-fd599520-7b35-4c77-961e-17bdff1f50b4 req-c07cdd0c-d53a-42a8-8579-ad7aef91ef93 tempest-TestStampPattern-81916239 None] Deleting attachment b85bc59f-e500-4059-a530-9b05dd7ebcb6. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:12:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b16bab-d018-4645-8120-08ad6e4014ad tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" by "attach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b16bab-d018-4645-8120-08ad6e4014ad tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" acquired by "attach_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-66b16bab-d018-4645-8120-08ad6e4014ad tempest-VolumesActionsTest-233116984 None] Attaching volume cac77294-d5e5-48f0-8b47-2ffa1b955025 to instance b2aa1529-6464-492f-bc37-e9885bb21107 at mountpoint /dev/vdb on host None. Apr 30 11:12:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-66b16bab-d018-4645-8120-08ad6e4014ad tempest-VolumesActionsTest-233116984 None] Attach volume completed successfully. Apr 30 11:12:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-66b16bab-d018-4645-8120-08ad6e4014ad tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" released by "attach_volume" :: held 0.076s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-44c6563b-c2cc-4631-9be4-ebc4a6907f57 tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" by "detach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-44c6563b-c2cc-4631-9be4-ebc4a6907f57 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-44c6563b-c2cc-4631-9be4-ebc4a6907f57 tempest-VolumesActionsTest-233116984 None] Detaching volume cac77294-d5e5-48f0-8b47-2ffa1b955025 from instance b2aa1529-6464-492f-bc37-e9885bb21107. Apr 30 11:12:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-44c6563b-c2cc-4631-9be4-ebc4a6907f57 tempest-VolumesActionsTest-233116984 None] Detach volume completed successfully. Apr 30 11:12:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-44c6563b-c2cc-4631-9be4-ebc4a6907f57 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "cinder-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c40b79-06d2-45a2-9bea-66495148c33c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:45 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 Apr 30 11:12:45 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:46 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" returned: 0 in 0.744s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:46 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8 Apr 30 11:12:46 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:47 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" returned: 0 in 0.697s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8" released by "delete_volume" :: held 1.478s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Created reservations ['fa65bc45-4718-4896-ad33-204c0ce7de28', '652667c3-8e60-4609-8016-606a9af7b900', '82aae0d0-6ae8-41e0-8f37-4f72da1113c2', 'e7ebd1a5-18d1-44c4-babf-345413a1ed31'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:47 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:12:47 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:47 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.579s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Deleted volume successfully. Apr 30 11:12:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b9e584fc-8518-4e21-8548-9210f86b5545 tempest-TestStampPattern-81916239 None] Lock "cinder-3c22b2ae-dd12-4d4b-bdff-1af33e5d8dc8-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-a3873839-7888-49be-9955-d6efc6947aa4-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-a3873839-7888-49be-9955-d6efc6947aa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Deleting offline snapshot a3873839-7888-49be-9955-d6efc6947aa4 of volume 6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] snapshot_file for this snap is: volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ba7115-efbd-46b2-92b3-b2f36141322a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:48 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:12:48 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:48 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.730s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b302b54-c988-46b4-9c03-9cc90352c9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3f2e4-5f95-4c33-8a9e-c0944bb84f65]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:49 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:12:49 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:49 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.680s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:49 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:12:49 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:50 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.707s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:50 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4 Apr 30 11:12:50 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:50 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4.a3873839-7888-49be-9955-d6efc6947aa4" returned: 0 in 0.576s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-a3873839-7888-49be-9955-d6efc6947aa4" released by "_delete_snapshot" :: held 2.800s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" released by "delete_snapshot" :: held 2.822s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:51 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Created reservations ['16fe430b-eca5-4bb2-a08f-345eef38e1cd', '24c4ab11-3a13-464f-87fb-3e063e03d042', '77593ccc-066d-42c5-aad0-808937c8a117', 'd4eb98b1-96e5-4340-85bf-2b349dc83e7f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Delete snapshot completed successfully. Apr 30 11:12:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a36ffb2e-92f1-4533-8ca0-212bbe7b7fe7 tempest-TestStampPattern-81916239 None] Lock "cinder-a3873839-7888-49be-9955-d6efc6947aa4-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-6b302b54-c988-46b4-9c03-9cc90352c9e4-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "cinder-6b302b54-c988-46b4-9c03-9cc90352c9e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Acquiring lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2c0843-38dd-493e-a267-33151447025c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:59 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:12:59 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:00 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.757s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:00 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4 Apr 30 11:13:00 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:01 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6b302b54-c988-46b4-9c03-9cc90352c9e4" returned: 0 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "cinder-quobyte-6b302b54-c988-46b4-9c03-9cc90352c9e4" released by "delete_volume" :: held 1.485s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Created reservations ['5c8e01f5-a87d-43a8-92af-b98156d13bc9', '53829cf1-15fc-4df3-a234-e4d452de9b23', '4d0bbd14-74a6-4f2d-9a1c-ee46f45f418a', 'ef14c90d-7e9b-415e-a8e1-8a2e538a8b56'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:01 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:13:01 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:01 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Deleted volume successfully. Apr 30 11:13:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fd55056b-5d63-4d6d-aa25-e9e9a1156572 tempest-TestStampPattern-81916239 None] Lock "cinder-6b302b54-c988-46b4-9c03-9cc90352c9e4-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:06 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:13:06 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:06 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.861s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89cb92b4-9190-4dfc-8e3c-f463a1bf6579 tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" by "attach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89cb92b4-9190-4dfc-8e3c-f463a1bf6579 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" acquired by "attach_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-89cb92b4-9190-4dfc-8e3c-f463a1bf6579 tempest-VolumesActionsTest-233116984 None] Attaching volume cac77294-d5e5-48f0-8b47-2ffa1b955025 to instance e8c03bed-02d8-4d0c-89df-45eb7f5fa6e0 at mountpoint /dev/vdb on host None. Apr 30 11:13:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-89cb92b4-9190-4dfc-8e3c-f463a1bf6579 tempest-VolumesActionsTest-233116984 None] Attach volume completed successfully. Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-89cb92b4-9190-4dfc-8e3c-f463a1bf6579 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025" released by "attach_volume" :: held 0.142s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d45ba3bc-ca2a-4fb2-9aec-954ea99bca2c tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" by "detach_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d45ba3bc-ca2a-4fb2-9aec-954ea99bca2c tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d45ba3bc-ca2a-4fb2-9aec-954ea99bca2c tempest-VolumesActionsTest-233116984 None] Detaching volume cac77294-d5e5-48f0-8b47-2ffa1b955025 from instance e8c03bed-02d8-4d0c-89df-45eb7f5fa6e0. Apr 30 11:13:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d45ba3bc-ca2a-4fb2-9aec-954ea99bca2c tempest-VolumesActionsTest-233116984 None] Detach volume completed successfully. Apr 30 11:13:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d45ba3bc-ca2a-4fb2-9aec-954ea99bca2c tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (a61a099d-b1cc-4ed5-9463-c4e0d886462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d2deba-2c67-43a9-bef2-6b99428348c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d2deba-2c67-43a9-bef2-6b99428348c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860753792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e45a375-9e0d-4427-b261-c58ae98c1bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:14Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6675c75d-2935-441e-8130-84d800e639e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6675c75d-2935-441e-8130-84d800e639e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520661c3-56cd-4817-8242-f749baf885aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520661c3-56cd-4817-8242-f749baf885aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e45a375-9e0d-4427-b261-c58ae98c1bca', 'volume_name': 'volume-1e45a375-9e0d-4427-b261-c58ae98c1bca', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eb9dc0-96d9-4974-83ed-bed5cf8c9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eb9dc0-96d9-4974-83ed-bed5cf8c9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad8884b-cb4e-43b8-bf6f-5d83f9e42d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:14 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume 1e45a375-9e0d-4427-b261-c58ae98c1bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e45a375-9e0d-4427-b261-c58ae98c1bca', 'volume_size': 1} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-860753792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e45a375-9e0d-4427-b261-c58ae98c1bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:14Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume 1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:14 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:14 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca 1073741824 Apr 30 11:13:14 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:14 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca 1073741824" returned: 0 in 0.774s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:15 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca Apr 30 11:13:15 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:15 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca" returned: 0 in 0.569s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad8884b-cb4e-43b8-bf6f-5d83f9e42d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e45a375-9e0d-4427-b261-c58ae98c1bca', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c86ca90-9a53-46db-b9b1-78bf2c65c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-1e45a375-9e0d-4427-b261-c58ae98c1bca (1e45a375-9e0d-4427-b261-c58ae98c1bca): created successfully Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c86ca90-9a53-46db-b9b1-78bf2c65c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (a61a099d-b1cc-4ed5-9463-c4e0d886462b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c434ad10-3c1a-4511-a0d3-0e6e61bb7234 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating offline snapshot bc7251e2-1047-4e32-aa81-356eb658c6ef of volume 1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:13:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c218e1-b89e-41eb-a36a-c0cfd8765221]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:16 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca Apr 30 11:13:16 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:17 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca" returned: 0 in 0.803s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:17 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef 1G Apr 30 11:13:17 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:18 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef 1G" returned: 0 in 0.744s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e45a375-9e0d-4427-b261-c58ae98c1bca -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:18 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e45a375-9e0d-4427-b261-c58ae98c1bca -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef Apr 30 11:13:18 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:18 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e45a375-9e0d-4427-b261-c58ae98c1bca -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef" returned: 0 in 0.616s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:18 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef is being set with open permissions: ugo+rw Apr 30 11:13:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:18 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef Apr 30 11:13:18 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:19 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef" returned: 0 in 0.556s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:19 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info Apr 30 11:13:19 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:19 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info" returned: 0 in 0.595s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:19 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info is being set with open permissions: ugo+rw Apr 30 11:13:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:19 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info Apr 30 11:13:19 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:20 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.info" returned: 0 in 0.580s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.988s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.831s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b84f7-c2d5-4b81-958b-ad75c4d53430]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5ca02f97-c132-4dec-9025-49d11f52c4a6 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Create snapshot completed successfully Apr 30 11:13:20 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:20 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (692b380e-75df-4d9f-9573-02baa2dc9eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd30274-bee2-4745-9ac0-125806036c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd30274-bee2-4745-9ac0-125806036c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500109830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c76d496-5432-4793-be68-4bcebfa6a66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3f41ff-d8a9-408b-96a2-33e304b3b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3f41ff-d8a9-408b-96a2-33e304b3b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e75eaa-532c-45ea-a921-660710229989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e75eaa-532c-45ea-a921-660710229989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c76d496-5432-4793-be68-4bcebfa6a66b', 'volume_name': 'volume-5c76d496-5432-4793-be68-4bcebfa6a66b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47775a71-ff22-4f6f-9fcf-1186f1694751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47775a71-ff22-4f6f-9fcf-1186f1694751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d071237-d5a5-4be2-a022-c1797529b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume 5c76d496-5432-4793-be68-4bcebfa6a66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c76d496-5432-4793-be68-4bcebfa6a66b', 'volume_size': 1} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:21 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f03307e-bea7-4927-be9f-a987517dc611]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:21 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:21 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (bd66be15-d9fa-40c9-8411-26ca5586681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6204ebee-a8b2-4e83-8163-7e44d5945686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6204ebee-a8b2-4e83-8163-7e44d5945686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157296680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aea6f3-7877-481a-bfd6-e98592663f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919bb213-6588-442a-bb37-f34fdf1b85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919bb213-6588-442a-bb37-f34fdf1b85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c8d65-a192-4f2e-a5e3-ca3a475baf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c8d65-a192-4f2e-a5e3-ca3a475baf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7aea6f3-7877-481a-bfd6-e98592663f23', 'volume_name': 'volume-e7aea6f3-7877-481a-bfd6-e98592663f23', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c7ce6-fddc-4796-9992-5c9808d5ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c7ce6-fddc-4796-9992-5c9808d5ea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70ab4e5-fc4c-4478-9744-dc38a111dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume e7aea6f3-7877-481a-bfd6-e98592663f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7aea6f3-7877-481a-bfd6-e98592663f23', 'volume_size': 1} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (bc70d00f-81e5-46b0-a9c9-00858d016b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ceafeb4-1a0d-45f2-aa65-830a7e94885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ceafeb4-1a0d-45f2-aa65-830a7e94885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468498593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7249e1d-9253-49ab-8c1f-d55d0f397db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c897e-e895-40d6-9f9f-5a259e648e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c897e-e895-40d6-9f9f-5a259e648e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c7e238-d5dc-4176-8e95-c638369aa4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c7e238-d5dc-4176-8e95-c638369aa4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7249e1d-9253-49ab-8c1f-d55d0f397db2', 'volume_name': 'volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748cb02a-eeb4-4e30-a9f8-a262e7415640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748cb02a-eeb4-4e30-a9f8-a262e7415640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fdc8f7-9999-423c-8e8c-f1114b4f895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume d7249e1d-9253-49ab-8c1f-d55d0f397db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2', 'volume_size': 1} Apr 30 11:13:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:22 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.819s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.54bffeaa-2db3-4a8f-b830-1b2a9def66e3xn9meizx.img {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:22 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.54bffeaa-2db3-4a8f-b830-1b2a9def66e3xn9meizx.img Apr 30 11:13:22 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (6febe57d-af9b-4f85-9bc9-37b6952292e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9308ae5-df7a-4a11-ad50-772e4498471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9308ae5-df7a-4a11-ad50-772e4498471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208922244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9117fea5-ce24-46d2-b0f3-bb07a473b9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcdf0ed-79ff-4534-8843-b9e1741e58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcdf0ed-79ff-4534-8843-b9e1741e58ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ec016b-b7db-4eed-a730-bff93bbc3018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ec016b-b7db-4eed-a730-bff93bbc3018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9117fea5-ce24-46d2-b0f3-bb07a473b9a5', 'volume_name': 'volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a65a87-f8c5-49fa-aadf-a647a50c3737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a65a87-f8c5-49fa-aadf-a647a50c3737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce69a54-76ab-4f72-9e0b-e9e057caa13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume 9117fea5-ce24-46d2-b0f3-bb07a473b9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5', 'volume_size': 1} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=47,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (980d8f22-c6a5-412e-ad16-0ff3b3c1fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b888bf00-1025-4b07-8ee7-3c7958606191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b888bf00-1025-4b07-8ee7-3c7958606191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-759806513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8940495-7e04-4fb7-960f-a912e0e6d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1845cb4f-4ec1-42da-b791-ea24cb8fd42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1845cb4f-4ec1-42da-b791-ea24cb8fd42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4814d-1cf6-4ed1-9c9c-4be648d4bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b4814d-1cf6-4ed1-9c9c-4be648d4bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8940495-7e04-4fb7-960f-a912e0e6d325', 'volume_name': 'volume-f8940495-7e04-4fb7-960f-a912e0e6d325', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af805fb-76cb-4c5a-8b4f-52a0df8915ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af805fb-76cb-4c5a-8b4f-52a0df8915ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000869ad-5435-4ad1-b005-8d85f63ca2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume f8940495-7e04-4fb7-960f-a912e0e6d325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8940495-7e04-4fb7-960f-a912e0e6d325', 'volume_size': 1} Apr 30 11:13:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:26 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.54bffeaa-2db3-4a8f-b830-1b2a9def66e3xn9meizx.img" returned: 0 in 4.042s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8422d03-ff5d-40f9-ad32-720a42fbe48a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:26 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:26 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:26 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.801s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.54bffeaa-2db3-4a8f-b830-1b2a9def66e3xn9meizx.img {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:13:26 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Converted 1024.00 MB image at 253.29 MB/s Apr 30 11:13:26 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] 54bffeaa-2db3-4a8f-b830-1b2a9def66e3 was raw, no need to convert to raw {{(pid=84432) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 30 11:13:32 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=40,cinder:SELECT=50,cinder:DELETE=3,cinder:INSERT=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:13:36 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.805s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Uploaded volume to glance image-id: 54bffeaa-2db3-4a8f-b830-1b2a9def66e3. {{(pid=84432) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.183s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500109830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c76d496-5432-4793-be68-4bcebfa6a66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume 5c76d496-5432-4793-be68-4bcebfa6a66b {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:45 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:45 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b 1073741824 Apr 30 11:13:45 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0f412dc8-112d-459b-9b8a-ae8ab98a7e23 tempest-VolumesActionsTest-233116984 None] Copy volume to image completed successfully. Apr 30 11:13:46 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b 1073741824" returned: 0 in 0.905s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:46 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b Apr 30 11:13:46 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:46 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b" returned: 0 in 0.586s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.355s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157296680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aea6f3-7877-481a-bfd6-e98592663f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume e7aea6f3-7877-481a-bfd6-e98592663f23 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:46 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:46 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 1073741824 Apr 30 11:13:46 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d071237-d5a5-4be2-a022-c1797529b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c76d496-5432-4793-be68-4bcebfa6a66b', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c1839-ac19-4f34-a618-4fe7b9575535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-5c76d496-5432-4793-be68-4bcebfa6a66b (5c76d496-5432-4793-be68-4bcebfa6a66b): created successfully Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c1839-ac19-4f34-a618-4fe7b9575535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (692b380e-75df-4d9f-9573-02baa2dc9eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-705a14ac-7f3b-46b6-99f1-8d54bbd10f38 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:47 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 1073741824" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:47 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 Apr 30 11:13:47 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:48 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23" returned: 0 in 0.557s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.344s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468498593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7249e1d-9253-49ab-8c1f-d55d0f397db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume d7249e1d-9253-49ab-8c1f-d55d0f397db2 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:48 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70ab4e5-fc4c-4478-9744-dc38a111dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7aea6f3-7877-481a-bfd6-e98592663f23', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:48 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 1073741824 Apr 30 11:13:48 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3939496-efed-4590-aa8c-f55f18a9ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-e7aea6f3-7877-481a-bfd6-e98592663f23 (e7aea6f3-7877-481a-bfd6-e98592663f23): created successfully Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3939496-efed-4590-aa8c-f55f18a9ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (bd66be15-d9fa-40c9-8411-26ca5586681f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-924c74c2-f49b-4da9-b602-dd4be8794634 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:48 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 1073741824" returned: 0 in 0.730s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:48 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 Apr 30 11:13:48 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:49 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2" returned: 0 in 0.562s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.304s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208922244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9117fea5-ce24-46d2-b0f3-bb07a473b9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume 9117fea5-ce24-46d2-b0f3-bb07a473b9a5 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:49 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:49 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 1073741824 Apr 30 11:13:49 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fdc8f7-9999-423c-8e8c-f1114b4f895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752f3455-0671-4013-b512-c225f7fd4954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 (d7249e1d-9253-49ab-8c1f-d55d0f397db2): created successfully Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752f3455-0671-4013-b512-c225f7fd4954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (bc70d00f-81e5-46b0-a9c9-00858d016b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1c982484-e7a6-4362-950a-c81331bc9e41 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:50 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 1073741824" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:50 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 Apr 30 11:13:50 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:50 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" returned: 0 in 0.634s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.374s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-759806513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8940495-7e04-4fb7-960f-a912e0e6d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ace93d85e4f268b7a89b4da3ff490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:22Z,use_quota=True,user_id='369a72c089dc44ebb7715a1c7b988c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Creating volume f8940495-7e04-4fb7-960f-a912e0e6d325 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:50 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:50 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 1073741824 Apr 30 11:13:50 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce69a54-76ab-4f72-9e0b-e9e057caa13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be2eb71-f55e-45ba-9f7d-bb359187a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:50 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 (9117fea5-ce24-46d2-b0f3-bb07a473b9a5): created successfully Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be2eb71-f55e-45ba-9f7d-bb359187a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (6febe57d-af9b-4f85-9bc9-37b6952292e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b1a99710-03ea-46d3-ab00-c421112b6fc5 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:51 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 1073741824" returned: 0 in 0.804s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:51 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 Apr 30 11:13:51 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:52 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325" returned: 0 in 0.580s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.888s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000869ad-5435-4ad1-b005-8d85f63ca2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8940495-7e04-4fb7-960f-a912e0e6d325', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84cd629-546b-4116-bff6-287d2d364cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2a13c-fa18-4ccc-84f2-f754e8fcaa7e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Volume volume-f8940495-7e04-4fb7-960f-a912e0e6d325 (f8940495-7e04-4fb7-960f-a912e0e6d325): created successfully Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84cd629-546b-4116-bff6-287d2d364cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Flow 'volume_create_manager' (980d8f22-c6a5-412e-ad16-0ff3b3c1fb76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f11a6e75-ee27-410e-8af0-ce75409ea36e tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created volume successfully. Apr 30 11:13:52 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:52 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-f8940495-7e04-4fb7-960f-a912e0e6d325-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-f8940495-7e04-4fb7-960f-a912e0e6d325-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-f8940495-7e04-4fb7-960f-a912e0e6d325" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-f8940495-7e04-4fb7-960f-a912e0e6d325" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd6fc1-4cf4-48ae-a65c-da8f7c4e5cc5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:52 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 Apr 30 11:13:52 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:53 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.789s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2dabda-649f-4c77-ab1d-e30df929d43b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:53 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:53 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:53 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:53 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325 Apr 30 11:13:53 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:53 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:53 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img Apr 30 11:13:53 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:54 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f8940495-7e04-4fb7-960f-a912e0e6d325" returned: 0 in 0.625s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-f8940495-7e04-4fb7-960f-a912e0e6d325" released by "delete_volume" :: held 1.436s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['843f1af2-9d8d-457a-a751-94f47fda5f8f', 'a2324e5b-422b-4cc7-9f87-e91434b11967', '9e163fe6-0d1b-4b28-a6a2-afa47c083a32', '7eee8a2d-73df-423d-bae9-0e2d0d69eb9d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:54 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:13:54 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-9117fea5-ce24-46d2-b0f3-bb07a473b9a5-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-9117fea5-ce24-46d2-b0f3-bb07a473b9a5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f6bcaa-6aee-4a78-84c8-a6a42ed6a2ba]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:55 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.110s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:13:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-35160b81-0432-4719-8a6e-f855692675d1 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-f8940495-7e04-4fb7-960f-a912e0e6d325-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:55 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 Apr 30 11:13:55 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:56 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" returned: 0 in 1.553s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:56 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5 Apr 30 11:13:56 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:57 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" returned: 0 in 1.064s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-9117fea5-ce24-46d2-b0f3-bb07a473b9a5" released by "delete_volume" :: held 2.710s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['06394cff-770c-4617-a043-c901728a8b69', '4ea74a05-1aab-4874-bd72-7e65b3bef3e0', 'a3caaaee-4faa-449b-8cfe-f39b4458135f', 'b64917ce-35a3-4e95-b680-fb09c875bee4'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:58 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:13:58 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-d7249e1d-9253-49ab-8c1f-d55d0f397db2-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-d7249e1d-9253-49ab-8c1f-d55d0f397db2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-d7249e1d-9253-49ab-8c1f-d55d0f397db2" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-d7249e1d-9253-49ab-8c1f-d55d0f397db2" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa97508-df18-4e62-b336-44fc074d625b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:58 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img" returned: 0 in 4.926s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afc66b3-f0e4-47aa-8e72-74dd8a45db40]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:58 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 Apr 30 11:13:58 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:58 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:13:58 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:59 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.814s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fe9f084d-61db-4fe0-94a2-5ff019f5201a tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-9117fea5-ce24-46d2-b0f3-bb07a473b9a5-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:59 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2" returned: 0 in 0.785s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:59 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2 Apr 30 11:13:59 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:59 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.906s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:13:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Converted 1024.00 MB image at 207.82 MB/s Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] 07ff66b7-9dc3-4d62-8050-8557fd1207ad was raw, converting to qcow2 {{(pid=84432) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc9a31e-a665-4c87-b6be-ee2e3a0503f5]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:59 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img Apr 30 11:13:59 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d7249e1d-9253-49ab-8c1f-d55d0f397db2" returned: 0 in 0.612s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-d7249e1d-9253-49ab-8c1f-d55d0f397db2" released by "delete_volume" :: held 1.449s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['9eba7500-50b5-424a-abbb-1936dd725da7', 'a15bc564-b28a-4728-9b32-7648c47dc9b3', 'a9fd63c2-5ac7-4972-a489-8965953d19c4', 'cad4774f-1f16-4cbb-8eff-2db144b4c561'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:00 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:00 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img" returned: 0 in 0.711s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:00 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img Apr 30 11:14:00 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-e7aea6f3-7877-481a-bfd6-e98592663f23-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-e7aea6f3-7877-481a-bfd6-e98592663f23-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-e7aea6f3-7877-481a-bfd6-e98592663f23" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:01 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.661s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-e7aea6f3-7877-481a-bfd6-e98592663f23" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f326623-ec0e-4d64-a41f-34d28a020c6e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-445791ee-075a-4d5c-bc1e-2b3482482180 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-d7249e1d-9253-49ab-8c1f-d55d0f397db2-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:01 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 Apr 30 11:14:01 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:01 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img" returned: 1 in 0.719s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:01 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q Apr 30 11:14:01 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:01 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23" returned: 0 in 0.734s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:01 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:01 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23 Apr 30 11:14:01 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q" returned: 0 in 0.618s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Image conversion details: src /opt/stack/data/cinder/conversion/cac77294-d5e5-48f0-8b47-2ffa1b955025.temp_image.07ff66b7-9dc3-4d62-8050-8557fd1207ad17f8unq1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:01 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e6971-9a74-4677-b7ae-7525b8663ccc]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:01 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q Apr 30 11:14:01 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:02 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e7aea6f3-7877-481a-bfd6-e98592663f23" returned: 0 in 0.624s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-e7aea6f3-7877-481a-bfd6-e98592663f23" released by "delete_volume" :: held 1.407s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['86aab149-9e75-41f9-a9f4-1a6042ce3258', '101012c9-f4cf-4cc9-bdfd-ec9cd667583a', '8ecf5102-13da-47ac-9cf6-e08e660f9046', '8a647d47-49e9-4423-b7db-fd7cb67f6d9b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:02 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nqn7eh2q" returned: 0 in 0.770s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:02 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:02 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-5c76d496-5432-4793-be68-4bcebfa6a66b-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-5c76d496-5432-4793-be68-4bcebfa6a66b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:03 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:03 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-5c76d496-5432-4793-be68-4bcebfa6a66b" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-5c76d496-5432-4793-be68-4bcebfa6a66b" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-11368ff6-1326-4723-b0aa-0986df36ead0 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-e7aea6f3-7877-481a-bfd6-e98592663f23-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3b9d1-1467-4057-918c-12ebe26e9870]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:03 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b Apr 30 11:14:03 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.714s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Uploaded volume to glance image-id: 07ff66b7-9dc3-4d62-8050-8557fd1207ad. {{(pid=84432) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 30 11:14:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8944dc67-5e0a-4ab6-80e2-6d9274b414fa tempest-VolumesActionsTest-233116984 None] Copy volume to image completed successfully. Apr 30 11:14:04 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b" returned: 0 in 0.737s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:04 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b Apr 30 11:14:04 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:04 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c76d496-5432-4793-be68-4bcebfa6a66b" returned: 0 in 0.780s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-5c76d496-5432-4793-be68-4bcebfa6a66b" released by "delete_volume" :: held 1.563s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:04 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['ba6833ea-49a4-4300-acc8-12b90848b3f1', 'e2c53b24-8ed0-4ff6-8435-a8d0213a2bd7', 'a43b55e5-88e1-4640-b626-7c884ec4935a', '34bdb4f1-a965-4003-9549-03751189119d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Acquiring lock "cinder-quobyte-cac77294-d5e5-48f0-8b47-2ffa1b955025" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "cinder-quobyte-cac77294-d5e5-48f0-8b47-2ffa1b955025" acquired by "delete_volume" :: waited 0.026s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a905ea-00fe-4d1c-990f-f0e6ee9df33d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:05 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:05 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:05 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:14:05 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-bc7251e2-1047-4e32-aa81-356eb658c6ef-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-bc7251e2-1047-4e32-aa81-356eb658c6ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-bc7251e2-1047-4e32-aa81-356eb658c6ef" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-bc7251e2-1047-4e32-aa81-356eb658c6ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleting offline snapshot bc7251e2-1047-4e32-aa81-356eb658c6ef of volume 1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] snapshot_file for this snap is: volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aecd59-1227-4135-b31c-e69a68a63fd2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:05 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef Apr 30 11:14:05 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:05 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:05 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.782s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:14:05 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025 Apr 30 11:14:05 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-10fe0ed1-fa8f-4339-a0af-08ccdaa6af99 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-5c76d496-5432-4793-be68-4bcebfa6a66b-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:06 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:06 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:06 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e45a375-9e0d-4427-b261-c58ae98c1bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:14:06 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-cac77294-d5e5-48f0-8b47-2ffa1b955025" returned: 0 in 0.614s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1eb6f9-0057-4b0b-8f70-fd71ab63a666]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "cinder-quobyte-cac77294-d5e5-48f0-8b47-2ffa1b955025" released by "delete_volume" :: held 1.451s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Created reservations ['8fc568b4-5ee7-4000-ac8e-f14c7b6fa1d5', 'a4b5f703-5afc-4281-8994-4c4fbe592e6e', '07e734a5-e8f7-4510-af94-dc151616d9ff', 'c0bbc4cc-ace8-44e9-bf2a-d4e4f9aba6f7'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:06 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca Apr 30 11:14:06 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:06 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:06 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:06 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.640s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:07 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:07 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Deleted volume successfully. Apr 30 11:14:07 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef Apr 30 11:14:07 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-551dfe3f-d684-4fc6-aa02-23e2e5284098 tempest-VolumesActionsTest-233116984 None] Lock "cinder-cac77294-d5e5-48f0-8b47-2ffa1b955025-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:08 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef" returned: 0 in 0.801s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:08 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef Apr 30 11:14:08 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:08 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca.bc7251e2-1047-4e32-aa81-356eb658c6ef" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-bc7251e2-1047-4e32-aa81-356eb658c6ef" released by "_delete_snapshot" :: held 3.299s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" released by "delete_snapshot" :: held 3.328s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:08 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['b807649f-a4b0-4d6e-9a10-bd61e7003f2a', '43e3e3e1-44b8-4a47-97e7-59b1ae79c350', '0214b7ed-6dfc-4ca8-ab12-e17310211317', '102e3d6b-b861-46a4-a8c1-e7fddf13606d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Delete snapshot completed successfully. Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1c2348e8-c32d-4150-8257-cab70bf42380 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-bc7251e2-1047-4e32-aa81-356eb658c6ef-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-1e45a375-9e0d-4427-b261-c58ae98c1bca-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-1e45a375-9e0d-4427-b261-c58ae98c1bca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0864282-a7cb-439e-9a1b-1823d83458cb]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:10 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca Apr 30 11:14:10 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:10 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca" returned: 0 in 0.781s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:10 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca Apr 30 11:14:10 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:11 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e45a375-9e0d-4427-b261-c58ae98c1bca" returned: 0 in 0.626s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-quobyte-1e45a375-9e0d-4427-b261-c58ae98c1bca" released by "delete_volume" :: held 1.475s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Created reservations ['f60eeab0-0348-476a-9007-a3f21c302946', 'd0646e22-620c-4b1b-998b-00321114656a', 'dd9c291c-bdaa-42ce-8c5e-66383b8196bc', '43f64135-78ad-4fe5-89f6-75b15c996857'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:11 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:11 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:12 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.670s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:12 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Deleted volume successfully. Apr 30 11:14:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fffc1e6-a9ca-4e8b-9d8d-b207136b4ab4 tempest-CreateVolumesFromSnapshotTest-1497996058 None] Lock "cinder-1e45a375-9e0d-4427-b261-c58ae98c1bca-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Flow 'volume_create_manager' (7549a42f-94a9-4af8-a722-cf806b31df9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc426e-c8b6-42cd-86f3-8f0b0d6ee9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc426e-c8b6-42cd-86f3-8f0b0d6ee9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842131178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b34cf40-fd81-44da-b0a3-1eaa3766fb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe09fa4a282480da537f391b971c886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:14Z,use_quota=True,user_id='b1a49f9613e7439aa5e89056cf238a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32ca96-723c-4cfd-a7e6-2686e0a4479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32ca96-723c-4cfd-a7e6-2686e0a4479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b2ade-491e-4212-9ab5-8932827a7b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b2ade-491e-4212-9ab5-8932827a7b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b34cf40-fd81-44da-b0a3-1eaa3766fb1d', 'volume_name': 'volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d', 'volume_size': 2}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d1a68e-3fd3-49c6-b68a-c2f514ed2b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d1a68e-3fd3-49c6-b68a-c2f514ed2b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1484ff4f-0242-4fbe-a3a4-c0365ab6eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:13 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Volume 4b34cf40-fd81-44da-b0a3-1eaa3766fb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d', 'volume_size': 2} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842131178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b34cf40-fd81-44da-b0a3-1eaa3766fb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe09fa4a282480da537f391b971c886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:14Z,use_quota=True,user_id='b1a49f9613e7439aa5e89056cf238a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Creating volume 4b34cf40-fd81-44da-b0a3-1eaa3766fb1d {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:13 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:14:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d 2147483648 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:13 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d 2147483648 Apr 30 11:14:13 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:14 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d 2147483648" returned: 0 in 0.798s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:14 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d Apr 30 11:14:14 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:15 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" returned: 0 in 0.607s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1484ff4f-0242-4fbe-a3a4-c0365ab6eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d', 'volume_size': 2}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048fccd2-ff65-4279-8e0a-c374f7231089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Volume volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d (4b34cf40-fd81-44da-b0a3-1eaa3766fb1d): created successfully Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048fccd2-ff65-4279-8e0a-c374f7231089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Flow 'volume_create_manager' (7549a42f-94a9-4af8-a722-cf806b31df9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-efd98a86-3f37-4780-b14c-3710c7908516 tempest-VolumesCloneNegativeTest-1053666408 None] Created volume successfully. Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Acquiring lock "cinder-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "cinder-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Acquiring lock "cinder-quobyte-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "cinder-quobyte-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4987cfb1-327c-4d97-881e-c0844e13531f]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:16 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d Apr 30 11:14:16 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:16 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" returned: 0 in 0.683s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:16 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d Apr 30 11:14:16 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:17 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" returned: 0 in 0.581s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "cinder-quobyte-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d" released by "delete_volume" :: held 1.305s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Created reservations ['82b45342-382c-4a4e-b7b8-da0397d71709', 'c0cc70fd-04ec-4e9c-b351-4c42ac88a0f1', '021a66ff-4e75-40c6-be32-a76a7674e306', 'd7d9324c-0808-48d7-8c69-9d8e4c440bc9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:17 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:17 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:17 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.593s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Deleted volume successfully. Apr 30 11:14:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0a753282-35c7-4be6-944d-1e7600a83f57 tempest-VolumesCloneNegativeTest-1053666408 None] Lock "cinder-4b34cf40-fd81-44da-b0a3-1eaa3766fb1d-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (f05a26f1-fc62-46bf-967b-8057a694f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510bd934-b773-4c28-8da3-21916850d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510bd934-b773-4c28-8da3-21916850d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1092342318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daad4fa-e1db-4b6f-8105-fb4d2de2d291,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:21Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271297c3-d054-41be-937b-9ab78f1ed69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271297c3-d054-41be-937b-9ab78f1ed69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b996a62-0a69-4c38-b5cf-84f4a6152dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b996a62-0a69-4c38-b5cf-84f4a6152dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0daad4fa-e1db-4b6f-8105-fb4d2de2d291', 'volume_name': 'volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d24b6-0052-4350-a99b-3c8791b2850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d24b6-0052-4350-a99b-3c8791b2850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c35a54-9e43-4399-b671-83bfa5555605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:20 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Volume 0daad4fa-e1db-4b6f-8105-fb4d2de2d291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291', 'volume_size': 1} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1092342318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0daad4fa-e1db-4b6f-8105-fb4d2de2d291,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:21Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Creating volume 0daad4fa-e1db-4b6f-8105-fb4d2de2d291 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:20 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:14:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:20 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 1073741824 Apr 30 11:14:20 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:21 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 1073741824" returned: 0 in 0.860s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:21 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 Apr 30 11:14:21 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:22 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" returned: 0 in 0.624s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c35a54-9e43-4399-b671-83bfa5555605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cbe993-3c93-47c8-9bae-b6286a671a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:22 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Volume volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 (0daad4fa-e1db-4b6f-8105-fb4d2de2d291): created successfully Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cbe993-3c93-47c8-9bae-b6286a671a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:22 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (f05a26f1-fc62-46bf-967b-8057a694f022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:22 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-233aa47a-b838-4f8e-9732-2d667613cf16 tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (623b73ee-900d-4641-b53c-7c6e9881d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf09699-5cff-452d-955f-50c76c6f774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf09699-5cff-452d-955f-50c76c6f774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870967195',display_name='tempest-VolumesGetTest-Volume-3754800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727cc01-6a08-48a4-9d41-130fb9e99e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:24Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34d8680-757a-4940-bae5-ec93d01fdc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34d8680-757a-4940-bae5-ec93d01fdc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af136db4-f933-4b2b-8459-e4fa475e6888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af136db4-f933-4b2b-8459-e4fa475e6888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9727cc01-6a08-48a4-9d41-130fb9e99e17', 'volume_name': 'volume-9727cc01-6a08-48a4-9d41-130fb9e99e17', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002e850d-a288-491a-9816-295ab1e21b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002e850d-a288-491a-9816-295ab1e21b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcc77da-9338-4f10-afa9-8b45e0abe99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:23 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Volume 9727cc01-6a08-48a4-9d41-130fb9e99e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9727cc01-6a08-48a4-9d41-130fb9e99e17', 'volume_size': 1} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-870967195',display_name='tempest-VolumesGetTest-Volume-3754800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727cc01-6a08-48a4-9d41-130fb9e99e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:24Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Creating volume 9727cc01-6a08-48a4-9d41-130fb9e99e17 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:23 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:14:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:23 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 1073741824 Apr 30 11:14:23 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:24 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 1073741824" returned: 0 in 0.828s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:24 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 Apr 30 11:14:24 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:25 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17" returned: 0 in 0.582s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcc77da-9338-4f10-afa9-8b45e0abe99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9727cc01-6a08-48a4-9d41-130fb9e99e17', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d601ebb4-d822-40cf-ac79-eb40193ba349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:25 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Volume volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 (9727cc01-6a08-48a4-9d41-130fb9e99e17): created successfully Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d601ebb4-d822-40cf-ac79-eb40193ba349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (623b73ee-900d-4641-b53c-7c6e9881d57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:25 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b0dda4f3-c6ed-432a-a073-7163db0b4bd6 tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-9727cc01-6a08-48a4-9d41-130fb9e99e17-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "cinder-9727cc01-6a08-48a4-9d41-130fb9e99e17-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-9727cc01-6a08-48a4-9d41-130fb9e99e17" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9727cc01-6a08-48a4-9d41-130fb9e99e17" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f03fe1-08c4-40f8-8392-19a8d5c8d469]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:26 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 Apr 30 11:14:26 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:26 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:26 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17 Apr 30 11:14:26 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:27 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9727cc01-6a08-48a4-9d41-130fb9e99e17" returned: 0 in 0.593s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9727cc01-6a08-48a4-9d41-130fb9e99e17" released by "delete_volume" :: held 1.365s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Created reservations ['ad9aca79-e428-4cbd-8c83-8121d8bb289b', '57f19efa-5a0a-4608-b396-1088c176567e', 'd54e438e-b016-4120-94da-8da05f83d58c', '3cbb35ae-a27f-4098-923a-26dcdaf03436'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:27 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:27 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:28 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.570s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:28 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-45ce164b-bbe3-480e-8488-21cdf8469b60 tempest-VolumesGetTest-823007693 None] Lock "cinder-9727cc01-6a08-48a4-9d41-130fb9e99e17-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-0daad4fa-e1db-4b6f-8105-fb4d2de2d291-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "cinder-0daad4fa-e1db-4b6f-8105-fb4d2de2d291-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5360c5-6e42-4085-9786-10cfb2220c90]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:28 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 Apr 30 11:14:28 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:28 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" returned: 0 in 0.696s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:28 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291 Apr 30 11:14:28 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:29 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" returned: 0 in 0.578s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-0daad4fa-e1db-4b6f-8105-fb4d2de2d291" released by "delete_volume" :: held 1.320s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Created reservations ['eb51dcdd-06c8-4b99-902b-4f48babc6fd8', 'da1bec9b-010a-4b62-94c6-631dd1efda54', '7650e25e-de3e-416b-adfa-b2a22becec73', 'a5df3f8b-bead-4548-b200-3d177529c155'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:29 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:29 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:30 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:30 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0e589266-d5b4-4860-bc9f-c4d89cc024a6 tempest-VolumesGetTest-823007693 None] Lock "cinder-0daad4fa-e1db-4b6f-8105-fb4d2de2d291-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (ea8e3d77-85ef-4379-8940-ba20d5f391b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acf03bd-2d59-421c-b906-04109f4b9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acf03bd-2d59-421c-b906-04109f4b9368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1254100018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beff7344-5927-40d1-a3dd-701ea5993a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:31Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8315c7b3-0ce4-4222-ba5f-d8d462081d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8315c7b3-0ce4-4222-ba5f-d8d462081d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63966f9-fd5d-4700-9d0d-e2514054f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63966f9-fd5d-4700-9d0d-e2514054f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beff7344-5927-40d1-a3dd-701ea5993a81', 'volume_name': 'volume-beff7344-5927-40d1-a3dd-701ea5993a81', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e41da59-a109-4483-81ea-ddd8c99bcd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e41da59-a109-4483-81ea-ddd8c99bcd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e089ce-2eb8-44c5-9187-dbeaad8046ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:30 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Volume beff7344-5927-40d1-a3dd-701ea5993a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beff7344-5927-40d1-a3dd-701ea5993a81', 'volume_size': 1} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1254100018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beff7344-5927-40d1-a3dd-701ea5993a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:31Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Creating volume beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:30 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:14:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:30 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 1073741824 Apr 30 11:14:30 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:31 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 1073741824" returned: 0 in 0.788s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:31 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:31 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:32 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.575s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e089ce-2eb8-44c5-9187-dbeaad8046ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beff7344-5927-40d1-a3dd-701ea5993a81', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cda878-0c67-4447-b151-55cbf8d3e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Volume volume-beff7344-5927-40d1-a3dd-701ea5993a81 (beff7344-5927-40d1-a3dd-701ea5993a81): created successfully Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cda878-0c67-4447-b151-55cbf8d3e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (ea8e3d77-85ef-4379-8940-ba20d5f391b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-bb36538b-d759-4aa8-bbe8-84b81ebea1df tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (65316c11-c442-457b-8f97-4750ca507763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9b7f09-995d-40df-bf92-a342204cd50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9b7f09-995d-40df-bf92-a342204cd50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-130919511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926f9175-c68c-4f22-b4f2-253bbf1a6bf0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=beff7344-5927-40d1-a3dd-701ea5993a81,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b558669-fc5a-4ad8-a3a6-f9781010dc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b558669-fc5a-4ad8-a3a6-f9781010dc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a277fe-d020-4fc8-887e-8fe6982ce839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a277fe-d020-4fc8-887e-8fe6982ce839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '926f9175-c68c-4f22-b4f2-253bbf1a6bf0', 'volume_name': 'volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0', 'volume_size': 1, 'source_volid': 'beff7344-5927-40d1-a3dd-701ea5993a81', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308194d1-6dae-4b79-ada4-35e704a5ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308194d1-6dae-4b79-ada4-35e704a5ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df110a56-a047-4b02-ac37-b8819b10382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Volume 926f9175-c68c-4f22-b4f2-253bbf1a6bf0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0', 'volume_size': 1, 'source_volid': 'beff7344-5927-40d1-a3dd-701ea5993a81', 'source_volstatus': 'available'} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:33 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Cloning volume beff7344-5927-40d1-a3dd-701ea5993a81 to volume 926f9175-c68c-4f22-b4f2-253bbf1a6bf0 Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Creating offline snapshot 9313bed5-410e-4442-bdef-4ba4141db572 of volume beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe9fae-6b1b-488d-be28-b89e2c40c968]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:33 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:33 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:34 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.723s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:34 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 1G Apr 30 11:14:34 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:34 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 1G" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beff7344-5927-40d1-a3dd-701ea5993a81 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:34 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beff7344-5927-40d1-a3dd-701ea5993a81 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:34 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:35 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beff7344-5927-40d1-a3dd-701ea5993a81 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.652s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:35 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 is being set with open permissions: ugo+rw Apr 30 11:14:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:35 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:35 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:36 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.605s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:36 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info Apr 30 11:14:36 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:36 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:36 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info is being set with open permissions: ugo+rw Apr 30 11:14:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:36 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info Apr 30 11:14:36 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:37 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.info" returned: 0 in 0.592s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] snapshot: 9313bed5-410e-4442-bdef-4ba4141db572, volume: 926f9175-c68c-4f22-b4f2-253bbf1a6bf0, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171f1b3-9722-48f2-9478-74aa9a6c0620]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:37 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:37 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:38 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beff7344-5927-40d1-a3dd-701ea5993a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f27d67-059b-4db1-ae34-e747d6e8af9d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:38 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:38 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:38 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.696s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:14:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:38 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 Apr 30 11:14:38 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:43 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" returned: 0 in 4.225s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfcc2fd-2b48-4bd6-ac79-6a7506427108]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:43 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:43 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:43 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.859s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:43 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Converted 1024.00 MB image at 242.28 MB/s Apr 30 11:14:43 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 is being set with open permissions: ugo+rw Apr 30 11:14:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:44 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 Apr 30 11:14:44 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:44 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" released by "_copy_volume_from_snapshot" :: held 7.140s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=120,cinder:DELETE=10 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-9313bed5-410e-4442-bdef-4ba4141db572" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9313bed5-410e-4442-bdef-4ba4141db572" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Deleting offline snapshot 9313bed5-410e-4442-bdef-4ba4141db572 of volume beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] snapshot_file for this snap is: volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3a21f-ea41-4e25-b7e4-839c61530f21]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:44 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:44 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:45 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beff7344-5927-40d1-a3dd-701ea5993a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:14:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3514572-0724-4b09-8d2a-b38be3efdd05]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:45 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:45 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:46 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:46 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:46 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:46 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=106,cinder:SELECT=79,cinder:DELETE=9,cinder:INSERT=32 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:14:46 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:46 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572 Apr 30 11:14:46 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:47 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81.9313bed5-410e-4442-bdef-4ba4141db572" returned: 0 in 0.579s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9313bed5-410e-4442-bdef-4ba4141db572" released by "_delete_snapshot" :: held 2.740s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df110a56-a047-4b02-ac37-b8819b10382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0', 'volume_size': 1, 'source_volid': 'beff7344-5927-40d1-a3dd-701ea5993a81', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885c009-d58f-421d-86a1-6a91867e80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Volume volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 (926f9175-c68c-4f22-b4f2-253bbf1a6bf0): created successfully Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885c009-d58f-421d-86a1-6a91867e80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (65316c11-c442-457b-8f97-4750ca507763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0c029614-2a05-482b-bd90-aaee47480928 tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (a0027dbd-f53c-475b-929e-04bd82fe2eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25ee71-4a87-4f1d-bc0a-a97667ab0b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25ee71-4a87-4f1d-bc0a-a97667ab0b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2128520642',display_name='tempest-VolumesGetTest-Volume-640100569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e33312-968d-4488-b08f-8fb5f53b543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:49Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb00378-d7ad-4162-b4ce-cbc9e151dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb00378-d7ad-4162-b4ce-cbc9e151dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547d483d-e213-4b41-b083-4b3b2b849e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547d483d-e213-4b41-b083-4b3b2b849e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e33312-968d-4488-b08f-8fb5f53b543a', 'volume_name': 'volume-c4e33312-968d-4488-b08f-8fb5f53b543a', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4093a209-bee0-4851-bd5e-53a947e39e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4093a209-bee0-4851-bd5e-53a947e39e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc200fa3-d584-4527-aa3f-1d1f9c11332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Volume c4e33312-968d-4488-b08f-8fb5f53b543a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e33312-968d-4488-b08f-8fb5f53b543a', 'volume_size': 1} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2128520642',display_name='tempest-VolumesGetTest-Volume-640100569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e33312-968d-4488-b08f-8fb5f53b543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:49Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Creating volume c4e33312-968d-4488-b08f-8fb5f53b543a {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:49 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:49 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a 1073741824 Apr 30 11:14:49 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:49 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a 1073741824" returned: 0 in 0.783s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:50 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a Apr 30 11:14:50 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:50 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a" returned: 0 in 0.587s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc200fa3-d584-4527-aa3f-1d1f9c11332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e33312-968d-4488-b08f-8fb5f53b543a', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4863169-8eba-49d3-886d-dba83bea1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:50 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Volume volume-c4e33312-968d-4488-b08f-8fb5f53b543a (c4e33312-968d-4488-b08f-8fb5f53b543a): created successfully Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4863169-8eba-49d3-886d-dba83bea1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:50 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (a0027dbd-f53c-475b-929e-04bd82fe2eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-25845d25-3c96-48e2-90e8-fe2df31b93ae tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-c4e33312-968d-4488-b08f-8fb5f53b543a-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "cinder-c4e33312-968d-4488-b08f-8fb5f53b543a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-c4e33312-968d-4488-b08f-8fb5f53b543a" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-c4e33312-968d-4488-b08f-8fb5f53b543a" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ddaf18-2bea-46a1-b92d-a73e9e09b911]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:51 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a Apr 30 11:14:51 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:52 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a" returned: 0 in 0.721s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:52 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a Apr 30 11:14:52 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:52 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4e33312-968d-4488-b08f-8fb5f53b543a" returned: 0 in 0.644s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-c4e33312-968d-4488-b08f-8fb5f53b543a" released by "delete_volume" :: held 1.406s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Created reservations ['8c2c5f38-8fe2-4c63-9b95-e4ce5674712e', '58216abc-7af1-43b7-b4ab-26f4c90c6e58', 'ea23f574-3dc2-4559-8e62-02bdcbc15fe7', 'dc651458-5b1d-45de-910d-107123a90038'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:52 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:52 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:53 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.644s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a06f1141-0984-4eda-a4fc-073f1f6e3e66 tempest-VolumesGetTest-823007693 None] Lock "cinder-c4e33312-968d-4488-b08f-8fb5f53b543a-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-926f9175-c68c-4f22-b4f2-253bbf1a6bf0-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "cinder-926f9175-c68c-4f22-b4f2-253bbf1a6bf0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753d07d-5565-40b7-a8ae-8d06d35a44ca]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:53 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 Apr 30 11:14:53 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:54 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" returned: 0 in 0.709s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:54 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0 Apr 30 11:14:54 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:55 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-926f9175-c68c-4f22-b4f2-253bbf1a6bf0" released by "delete_volume" :: held 1.368s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Created reservations ['1a2d01d9-02aa-41fa-9385-6b805a02b117', '71c6bb9d-618f-4297-a053-5b15e113b3ca', '327a47ca-f051-4bb9-a853-032c7276474d', '1fabadcb-a6b2-432e-90a1-3b0b6143a950'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:55 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:55 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:55 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.600s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-67cc86c5-d728-4664-8960-71eb2bf029d5 tempest-VolumesGetTest-823007693 None] Lock "cinder-926f9175-c68c-4f22-b4f2-253bbf1a6bf0-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-beff7344-5927-40d1-a3dd-701ea5993a81-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "cinder-beff7344-5927-40d1-a3dd-701ea5993a81-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-beff7344-5927-40d1-a3dd-701ea5993a81" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-beff7344-5927-40d1-a3dd-701ea5993a81" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe290f-5cbc-454a-be1f-46803361a5e6]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:56 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:56 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:56 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.713s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:56 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81 Apr 30 11:14:56 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:57 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-beff7344-5927-40d1-a3dd-701ea5993a81" returned: 0 in 0.671s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-beff7344-5927-40d1-a3dd-701ea5993a81" released by "delete_volume" :: held 1.445s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Created reservations ['093b9670-c03f-441c-9789-40b710a10b12', '106c5051-7600-46a7-8f9f-1fb5eccb4e25', '230631c6-f720-4889-828a-bb4f24743726', 'd7acbf4e-78cc-449e-9b1d-a14e881f3772'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:57 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:14:57 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:58 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.629s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:58 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-7f39309f-85e0-4497-8ad6-928f507fe518 tempest-VolumesGetTest-823007693 None] Lock "cinder-beff7344-5927-40d1-a3dd-701ea5993a81-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (a87b8428-d439-47b9-a727-c61a97d0f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:58 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bbd18c-a6c5-4ef6-933a-d6c1bcf01ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bbd18c-a6c5-4ef6-933a-d6c1bcf01ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-90732728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3cd60d-76f1-47f0-abf4-0b20f15acc19,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:59Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8745c958-4ffe-4730-9a3b-d7d1b84dda8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8745c958-4ffe-4730-9a3b-d7d1b84dda8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e937fc47-7011-4964-825a-6ea5c4d81051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e937fc47-7011-4964-825a-6ea5c4d81051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e3cd60d-76f1-47f0-abf4-0b20f15acc19', 'volume_name': 'volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d0e628-faf9-436d-8876-22ac0132b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d0e628-faf9-436d-8876-22ac0132b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fce5e-0bb3-4540-9b98-fc925dab41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:59 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Trying to clone 1e3cd60d-76f1-47f0-abf4-0b20f15acc19 from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:14:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ce188-8b35-442d-afcb-82c28b95afb9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:59 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD Apr 30 11:14:59 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:00 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:00 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 is fetched for user 0a44b7b184db416c8a356b51743bf7da. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:15:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde5f7e1-9fc7-4a06-8eac-0a45d73fc41d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:00 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD Apr 30 11:15:00 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:01 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-90732728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3cd60d-76f1-47f0-abf4-0b20f15acc19,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:59Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Creating volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:01 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:15:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:01 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1073741824 Apr 30 11:15:01 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:01 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1073741824" returned: 0 in 0.793s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:02 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:02 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 0 in 0.588s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Attempting download of 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ebf74f-5967-4daa-9984-4293bc43ec6a]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g Apr 30 11:15:02 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:03 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g" returned: 0 in 0.626s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g Apr 30 11:15:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:03 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g" returned: 1 in 0.649s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_ey6n7q8g' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a53a0d0-9c4c-4d6c-b59e-57b263f1e45b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD Apr 30 11:15:04 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:04 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD" returned: 0 in 0.656s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:04 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:15:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:04 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:06 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:15:06 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 0 in 1.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52cf5823-fd6f-4405-8c4b-2a0749f2d8e1_1itpc_d5devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:15:06 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Converted 112.00 MB image at 61.21 MB/s Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:06 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1G Apr 30 11:15:06 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.650s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:07 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 1G" returned: 0 in 0.621s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:07 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[48904ca6-62a4-49bd-9b6d-0888a4a14972]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:07 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:07 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:07 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:07 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:07 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:08 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 1 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Downloaded image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}])) to volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Temporary image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 for user 0a44b7b184db416c8a356b51743bf7da is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Marking volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Copying metadata from image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 to 1e3cd60d-76f1-47f0-abf4-0b20f15acc19. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Creating volume glance metadata for volume 1e3cd60d-76f1-47f0-abf4-0b20f15acc19 backed by image 52cf5823-fd6f-4405-8c4b-2a0749f2d8e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fce5e-0bb3-4540-9b98-fc925dab41b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19', 'volume_size': 1, 'image_id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '825f96f6d1f442aba9e4bbec66e5f894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '52cf5823-fd6f-4405-8c4b-2a0749f2d8e1', 'created_at': datetime.datetime(2026, 4, 30, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52cf5823-fd6f-4405-8c4b-2a0749f2d8e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b71a7a-eea5-4938-9786-921fd094a2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Volume volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 (1e3cd60d-76f1-47f0-abf4-0b20f15acc19): created successfully Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b71a7a-eea5-4938-9786-921fd094a2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (a87b8428-d439-47b9-a727-c61a97d0f333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b8049f5a-ef13-4d63-abd9-c1c4e2b12d52 tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (915c26e7-5554-48d8-b8b2-c7b59135ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8cb83d-8d8b-4eca-b1f9-c9555179a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8cb83d-8d8b-4eca-b1f9-c9555179a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673903900',display_name='tempest-VolumesGetTest-Volume-1857800013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c969e94-8d26-4f45-99f2-80ceeb98c16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:10Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e075d6-362c-42ed-95ac-b59dfcde5a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e075d6-362c-42ed-95ac-b59dfcde5a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5212a1da-2dbe-48a8-9c03-3728e74595a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5212a1da-2dbe-48a8-9c03-3728e74595a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c969e94-8d26-4f45-99f2-80ceeb98c16c', 'volume_name': 'volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabdbc16-2e74-42c5-8d31-8f2c03301b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabdbc16-2e74-42c5-8d31-8f2c03301b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7873829c-65b1-4a20-afda-dbc9dc97ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Volume 9c969e94-8d26-4f45-99f2-80ceeb98c16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c', 'volume_size': 1} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673903900',display_name='tempest-VolumesGetTest-Volume-1857800013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c969e94-8d26-4f45-99f2-80ceeb98c16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90fa3f88b1f4003a06a10ac63b0bc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:10Z,use_quota=True,user_id='0a44b7b184db416c8a356b51743bf7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Creating volume 9c969e94-8d26-4f45-99f2-80ceeb98c16c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:10 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:15:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:10 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c 1073741824 Apr 30 11:15:10 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:11 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c 1073741824" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:11 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c Apr 30 11:15:11 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:11 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7873829c-65b1-4a20-afda-dbc9dc97ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332e1d9-af7e-4678-b9ff-acdad06ea55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Volume volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c (9c969e94-8d26-4f45-99f2-80ceeb98c16c): created successfully Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332e1d9-af7e-4678-b9ff-acdad06ea55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Flow 'volume_create_manager' (915c26e7-5554-48d8-b8b2-c7b59135ef96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c7d42a1d-c647-4c7b-831d-096a99717285 tempest-VolumesGetTest-823007693 None] Created volume successfully. Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-9c969e94-8d26-4f45-99f2-80ceeb98c16c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "cinder-9c969e94-8d26-4f45-99f2-80ceeb98c16c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-9c969e94-8d26-4f45-99f2-80ceeb98c16c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9c969e94-8d26-4f45-99f2-80ceeb98c16c" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd631a6-aef6-4e01-a0a6-754e5cbd9601]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:12 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c Apr 30 11:15:12 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:13 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c" returned: 0 in 0.744s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:13 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c Apr 30 11:15:13 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:13 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9c969e94-8d26-4f45-99f2-80ceeb98c16c" returned: 0 in 0.604s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-9c969e94-8d26-4f45-99f2-80ceeb98c16c" released by "delete_volume" :: held 1.386s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Created reservations ['3b70736a-0392-4b56-8de1-f565a366d5cc', '21242851-7544-4622-a382-251471205e0e', '96370185-c6eb-4151-a90d-0a94bdea42f0', 'af1ae1e4-5081-4a02-8ba2-1952b124db43'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:14 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:15:14 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:14 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:14 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b6399158-9cd2-459d-9337-f70b2a10e277 tempest-VolumesGetTest-823007693 None] Lock "cinder-9c969e94-8d26-4f45-99f2-80ceeb98c16c-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-1e3cd60d-76f1-47f0-abf4-0b20f15acc19-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "cinder-1e3cd60d-76f1-47f0-abf4-0b20f15acc19-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Acquiring lock "cinder-quobyte-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6cdd1-af84-4ded-a7e6-88f226e186d1]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:15 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:15 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:15 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 0 in 0.700s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:15 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:15 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:16 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 1 in 0.679s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:16 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19 Apr 30 11:15:16 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:16 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "cinder-quobyte-1e3cd60d-76f1-47f0-abf4-0b20f15acc19" released by "delete_volume" :: held 2.008s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:16 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Created reservations ['a1c33698-688a-43fd-90d2-1b48175aea6e', '2c2ed8a5-d61b-48a1-a35c-eb7a3b6b4d2f', '49d173af-0413-463c-8c92-4b097ae41c2b', 'c2b3e218-684b-4780-aef5-d98ef5502373'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:17 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:15:17 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:17 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.622s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Deleted volume successfully. Apr 30 11:15:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-01bf0184-c455-4b19-80a6-c66849c5b860 tempest-VolumesGetTest-823007693 None] Lock "cinder-1e3cd60d-76f1-47f0-abf4-0b20f15acc19-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:27 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=57,cinder:SELECT=40,cinder:DELETE=4,cinder:INSERT=18 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:15:27 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=50,cinder:SELECT=39,cinder:INSERT=19,cinder:DELETE=5 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (d1c9219c-7408-4c92-adb3-02b522d77373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4817fe-b482-4b41-857e-1f00ee515325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4817fe-b482-4b41-857e-1f00ee515325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094044461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17110c2-ffad-46e5-9472-21b798fa7845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:43Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d17936d-fd75-410e-864d-8c34c388c715),volume_type_id=8d17936d-fd75-410e-864d-8c34c388c715)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd262e3a-be7b-4e47-b16a-860b0e33b0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd262e3a-be7b-4e47-b16a-860b0e33b0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1486556-15bd-420b-86d6-792ad13c92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1486556-15bd-420b-86d6-792ad13c92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17110c2-ffad-46e5-9472-21b798fa7845', 'volume_name': 'volume-e17110c2-ffad-46e5-9472-21b798fa7845', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b1b573-e3e8-451c-ada4-958fa7510e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b1b573-e3e8-451c-ada4-958fa7510e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a71328-0b94-4754-a27a-d7df7d617a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume e17110c2-ffad-46e5-9472-21b798fa7845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17110c2-ffad-46e5-9472-21b798fa7845', 'volume_size': 1} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094044461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17110c2-ffad-46e5-9472-21b798fa7845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:43Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d17936d-fd75-410e-864d-8c34c388c715),volume_type_id=8d17936d-fd75-410e-864d-8c34c388c715)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Creating volume e17110c2-ffad-46e5-9472-21b798fa7845 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:43 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:43 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 1073741824 Apr 30 11:15:43 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (74283c49-c263-43d8-89fe-5d3be6d3c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a33a9-b398-4cfe-92ae-2a8a79b1018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a33a9-b398-4cfe-92ae-2a8a79b1018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1354518680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c6c6f4-172c-4173-b2ad-7a82978678d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:43Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a7ae896-0f86-41b4-9b21-ec22727bd70f),volume_type_id=9a7ae896-0f86-41b4-9b21-ec22727bd70f)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878ff5fa-2659-4e37-a8cc-1045776ff199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878ff5fa-2659-4e37-a8cc-1045776ff199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184cd1cd-cd1e-497e-b160-bce2fd1dee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184cd1cd-cd1e-497e-b160-bce2fd1dee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c6c6f4-172c-4173-b2ad-7a82978678d8', 'volume_name': 'volume-30c6c6f4-172c-4173-b2ad-7a82978678d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea51c601-ab7a-47d5-8abf-bfa49704f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea51c601-ab7a-47d5-8abf-bfa49704f06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2fc4a7-8dc3-4d28-b561-68fa8f0a8a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume 30c6c6f4-172c-4173-b2ad-7a82978678d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c6c6f4-172c-4173-b2ad-7a82978678d8', 'volume_size': 1} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (7b17b71c-2537-47e3-9e5a-06cba762d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1441ef6d-a99f-4df2-b899-b36e44e2ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1441ef6d-a99f-4df2-b899-b36e44e2ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1668624982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028298cc-7de1-4465-8de6-6c5bf3f4b4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:44Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efdf8c9f-42db-4d41-b10c-70921374c331),volume_type_id=efdf8c9f-42db-4d41-b10c-70921374c331)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5158ce80-491c-424b-8c95-ec5a2b532ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5158ce80-491c-424b-8c95-ec5a2b532ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6575336-925d-452c-b642-d295f9eeb978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:43 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:15:44 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 1073741824" returned: 0 in 0.879s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:44 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 Apr 30 11:15:44 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6575336-925d-452c-b642-d295f9eeb978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '028298cc-7de1-4465-8de6-6c5bf3f4b4fa', 'volume_name': 'volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa', 'volume_size': 1, 'image_id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--753852734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '751077b8d3534a208e59cf13766567a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'created_at': datetime.datetime(2026, 4, 30, 9, 15, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd00c137-df11-4788-a286-cc79ef0ddda6/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c1327-ac45-4ce0-ab4b-1bafa4905d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c1327-ac45-4ce0-ab4b-1bafa4905d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa9549a-7f8b-484d-b263-a07ee6c0759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa', 'volume_size': 1, 'image_id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--753852734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '751077b8d3534a208e59cf13766567a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'created_at': datetime.datetime(2026, 4, 30, 9, 15, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd00c137-df11-4788-a286-cc79ef0ddda6/file', 'properties': {}}, 'image_service': } Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Trying to clone 028298cc-7de1-4465-8de6-6c5bf3f4b4fa from image dd00c137-df11-4788-a286-cc79ef0ddda6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:15:44 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845" returned: 0 in 0.617s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1354518680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c6c6f4-172c-4173-b2ad-7a82978678d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:43Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a7ae896-0f86-41b4-9b21-ec22727bd70f),volume_type_id=9a7ae896-0f86-41b4-9b21-ec22727bd70f)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Creating volume 30c6c6f4-172c-4173-b2ad-7a82978678d8 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:44 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:44 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 1073741824 Apr 30 11:15:44 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a71328-0b94-4754-a27a-d7df7d617a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17110c2-ffad-46e5-9472-21b798fa7845', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3b4d3e-6812-47ab-a1e7-24fb64f4a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume volume-e17110c2-ffad-46e5-9472-21b798fa7845 (e17110c2-ffad-46e5-9472-21b798fa7845): created successfully Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3b4d3e-6812-47ab-a1e7-24fb64f4a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (d1c9219c-7408-4c92-adb3-02b522d77373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5fdac5b5-d243-42ed-9331-b85f8a56047b tempest-TestInstancesWithCinderVolumes-1695505090 None] Created volume successfully. Apr 30 11:15:45 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 1073741824" returned: 0 in 0.850s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:45 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 Apr 30 11:15:45 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:46 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8" returned: 0 in 0.606s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2fc4a7-8dc3-4d28-b561-68fa8f0a8a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c6c6f4-172c-4173-b2ad-7a82978678d8', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76106736-ba31-4457-b5e9-69a56b8887d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 (30c6c6f4-172c-4173-b2ad-7a82978678d8): created successfully Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76106736-ba31-4457-b5e9-69a56b8887d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (74283c49-c263-43d8-89fe-5d3be6d3c39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-95f7a354-310f-447f-8522-512a80c1d616 tempest-TestInstancesWithCinderVolumes-1695505090 None] Created volume successfully. Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD, size 20.69 MB, duration 2.96 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:15:47 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Image download 20.69 MB at 6.98 MB/s Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaea175-0527-4893-830e-e65f738e65cf]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:47 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD Apr 30 11:15:47 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:47 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Temporary image dd00c137-df11-4788-a286-cc79ef0ddda6 is fetched for user 52113b9749a44d6b8607793927b8b872. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2743dbcb-4d6f-4740-a886-efabd3d7b214]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:48 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD Apr 30 11:15:48 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:48 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1668624982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028298cc-7de1-4465-8de6-6c5bf3f4b4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751077b8d3534a208e59cf13766567a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:44Z,use_quota=True,user_id='52113b9749a44d6b8607793927b8b872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efdf8c9f-42db-4d41-b10c-70921374c331),volume_type_id=efdf8c9f-42db-4d41-b10c-70921374c331)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Creating volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:48 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:15:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:48 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1073741824 Apr 30 11:15:48 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:49 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1073741824" returned: 0 in 0.769s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:49 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:15:49 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 0.581s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Attempting download of dd00c137-df11-4788-a286-cc79ef0ddda6 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}])) to volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32c1f5-2f2f-4273-b789-6d641a211b7c]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j Apr 30 11:15:50 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j Apr 30 11:15:50 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:51 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j" returned: 1 in 0.638s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd00c137-df11-4788-a286-cc79ef0ddda6_7rrn7k3j' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:51 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1758b89-ce9e-4c0f-9635-167b61eb5491]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:51 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD Apr 30 11:15:51 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:52 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:52 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] dd00c137-df11-4788-a286-cc79ef0ddda6 was qcow2, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:15:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:52 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:15:52 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:53 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 1.738s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:53 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd00c137-df11-4788-a286-cc79ef0ddda6_odfyxzpbdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:15:53 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Converted 112.00 MB image at 64.38 MB/s Apr 30 11:15:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:53 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1G Apr 30 11:15:53 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:54 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa 1G" returned: 0 in 0.675s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50851ea-ff23-4d74-b9d1-c6cac33f60f9]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:54 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:15:54 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:55 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 0.688s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:55 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:15:55 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:55 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 1 in 0.712s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Downloaded image dd00c137-df11-4788-a286-cc79ef0ddda6 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}])) to volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Temporary image dd00c137-df11-4788-a286-cc79ef0ddda6 for user 52113b9749a44d6b8607793927b8b872 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Marking volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Copying metadata from image dd00c137-df11-4788-a286-cc79ef0ddda6 to 028298cc-7de1-4465-8de6-6c5bf3f4b4fa. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:15:55 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Creating volume glance metadata for volume 028298cc-7de1-4465-8de6-6c5bf3f4b4fa backed by image dd00c137-df11-4788-a286-cc79ef0ddda6 with: {'image_id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'image_name': 'tempest-scenario-img--753852734', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:15:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa9549a-7f8b-484d-b263-a07ee6c0759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa', 'volume_size': 1, 'image_id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd00c137-df11-4788-a286-cc79ef0ddda6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--753852734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '751077b8d3534a208e59cf13766567a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd00c137-df11-4788-a286-cc79ef0ddda6', 'created_at': datetime.datetime(2026, 4, 30, 9, 15, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 15, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd00c137-df11-4788-a286-cc79ef0ddda6/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48da0d75-e644-4a54-aac0-324cf3dd8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:56 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Volume volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa (028298cc-7de1-4465-8de6-6c5bf3f4b4fa): created successfully Apr 30 11:15:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48da0d75-e644-4a54-aac0-324cf3dd8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Flow 'volume_create_manager' (7b17b71c-2537-47e3-9e5a-06cba762d86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1d9c420f-727d-46d7-af95-c07da2ece1c6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Created volume successfully. Apr 30 11:16:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e417d-9aaf-4c8c-861c-ba1c8b99b498]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:03 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:16:03 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:04 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 0.713s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:04 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:16:04 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:05 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 1 in 0.719s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:16:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.472s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14cbf4f3-4bca-4bfa-ac23-c4abe62eeba0', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:16:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-7beb8662-3b92-4866-b38f-15b754281a26 req-1bce3bf9-6bb9-4ff4-9e0a-b163ef17f631 tempest-TestInstancesWithCinderVolumes-1695505090 None] attachment_update completed successfully. Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:06 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:16:06 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:06 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.588s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:15 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=7,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:16:15 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:16:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:41 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db51921-3bd7-4449-bcc2-366a7cf25af4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:42 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 Apr 30 11:16:42 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:42 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845" returned: 0 in 0.729s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-e17110c2-ffad-46e5-9472-21b798fa7845', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d93cfea-a986-4a8e-a956-bbf33c548403', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:16:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-99603135-a542-4547-afcb-ee4fe7d14d7c req-f7e562fb-b09e-49ad-9dc2-7a67db4616be tempest-TestInstancesWithCinderVolumes-1695505090 None] attachment_update completed successfully. Apr 30 11:16:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdfe41-ac81-4654-9dc1-83b1307d0bb9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:50 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 Apr 30 11:16:50 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:51 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.701s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-30c6c6f4-172c-4173-b2ad-7a82978678d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53d3d25a-d5ae-4c58-b98a-4d5098003daa', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:16:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-3ebbeb3b-ceb6-4b3b-8907-4b8d4e9b33b8 req-2e3ba1e3-5c4b-4457-b5c2-b52e403c97d6 tempest-TestInstancesWithCinderVolumes-1695505090 None] attachment_update completed successfully. Apr 30 11:16:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-ec7d5afe-df8b-4616-859f-5cd8177ac631 req-6b2ddde7-211f-467d-8d71-adbbf06580ae tempest-TestInstancesWithCinderVolumes-1695505090 None] Terminate volume connection completed successfully. Apr 30 11:16:59 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-ec7d5afe-df8b-4616-859f-5cd8177ac631 req-6b2ddde7-211f-467d-8d71-adbbf06580ae tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleting attachment 1d93cfea-a986-4a8e-a956-bbf33c548403. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-e17110c2-ffad-46e5-9472-21b798fa7845-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-e17110c2-ffad-46e5-9472-21b798fa7845-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-quobyte-e17110c2-ffad-46e5-9472-21b798fa7845" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-e17110c2-ffad-46e5-9472-21b798fa7845" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a0947-78c1-490c-82bc-013c62efffa3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:01 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 Apr 30 11:17:01 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:02 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845" returned: 0 in 0.713s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:02 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845 Apr 30 11:17:02 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:03 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e17110c2-ffad-46e5-9472-21b798fa7845" returned: 0 in 0.609s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-e17110c2-ffad-46e5-9472-21b798fa7845" released by "delete_volume" :: held 1.379s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:03 devstack cinder-volume[84432]: WARNING cinder.quota [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622409363-2021000589 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622409363-2021000589, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:03 devstack cinder-volume[84432]: WARNING cinder.quota [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622409363-2021000589 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622409363-2021000589, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Created reservations ['ae91ec5b-6491-4981-9421-6a45a11cc770', '412ca2e2-bec4-4ce4-b624-fb102f682c3f', 'a310ba90-fa21-4129-81c3-f7c6110a09cb', '4b849bb2-f2bb-478a-9826-606e7c4cd49a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:03 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:17:03 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:03 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.635s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:03 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleted volume successfully. Apr 30 11:17:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0834d394-a195-4d27-b1cc-f8cf4d8a61e7 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-e17110c2-ffad-46e5-9472-21b798fa7845-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:06 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-2161e866-9607-4548-8e29-84115f39be80 req-41190a84-5a60-4bd7-864e-29a9f9599ba9 tempest-TestInstancesWithCinderVolumes-1695505090 None] Terminate volume connection completed successfully. Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-2161e866-9607-4548-8e29-84115f39be80 req-41190a84-5a60-4bd7-864e-29a9f9599ba9 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleting attachment 53d3d25a-d5ae-4c58-b98a-4d5098003daa. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:06 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:17:06 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:06 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.589s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-30c6c6f4-172c-4173-b2ad-7a82978678d8-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-30c6c6f4-172c-4173-b2ad-7a82978678d8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-quobyte-30c6c6f4-172c-4173-b2ad-7a82978678d8" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-30c6c6f4-172c-4173-b2ad-7a82978678d8" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cbcdf-b020-4668-ae25-6ad556ae8090]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:08 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 Apr 30 11:17:08 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:08 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8" returned: 0 in 0.724s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:08 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8 Apr 30 11:17:08 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:09 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-30c6c6f4-172c-4173-b2ad-7a82978678d8" returned: 0 in 0.620s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-30c6c6f4-172c-4173-b2ad-7a82978678d8" released by "delete_volume" :: held 1.390s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:09 devstack cinder-volume[84432]: WARNING cinder.quota [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1128341599-1529851880 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1128341599-1529851880, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:09 devstack cinder-volume[84432]: WARNING cinder.quota [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1128341599-1529851880 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1128341599-1529851880, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Created reservations ['b449c664-1b7e-449d-bc71-df05a36771ac', '28ebfbe5-d60b-4a8c-8f18-11ba436480cf', '45c1b8e5-60af-4d7f-b103-2a0c28f53443', '1f294543-73d3-477e-918b-c72d6595bb35'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:09 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:17:09 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:10 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:10 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:10 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleted volume successfully. Apr 30 11:17:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ca4d1e1-c80e-4b64-bc12-ecac1cb1223c tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-30c6c6f4-172c-4173-b2ad-7a82978678d8-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:14 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-f6407ea9-afd2-4b79-bdb9-33b4fe468978 req-37ede21f-5c11-44cc-b12f-3b69acf9613a tempest-TestInstancesWithCinderVolumes-1695505090 None] Terminate volume connection completed successfully. Apr 30 11:17:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-f6407ea9-afd2-4b79-bdb9-33b4fe468978 req-37ede21f-5c11-44cc-b12f-3b69acf9613a tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleting attachment 14cbf4f3-4bca-4bfa-ac23-c4abe62eeba0. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-028298cc-7de1-4465-8de6-6c5bf3f4b4fa-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-028298cc-7de1-4465-8de6-6c5bf3f4b4fa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "cinder-quobyte-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[84538fb5-de94-4b1b-8184-e99de58ac56d]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:17 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:17:17 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:18 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:18 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:17:18 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:19 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 1 in 0.702s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:19 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa Apr 30 11:17:19 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:19 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-quobyte-028298cc-7de1-4465-8de6-6c5bf3f4b4fa" released by "delete_volume" :: held 2.137s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:19 devstack cinder-volume[84432]: WARNING cinder.quota [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1474787079-1805921941 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1474787079-1805921941, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:19 devstack cinder-volume[84432]: WARNING cinder.quota [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1474787079-1805921941 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1474787079-1805921941, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:17:19 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Created reservations ['7a2b35f6-984f-45b1-8e24-af3901e6096a', '19555e5e-cf02-499f-8da4-2bbe3df6f6f0', '23bd0e48-4ad8-4f60-a14d-5e98fc04fbfb', 'e7412c44-f842-400a-959f-29592974cf84'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:20 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:17:20 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:20 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.589s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Deleted volume successfully. Apr 30 11:17:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c48fea-938a-49ac-9f16-e57b9bb34857 tempest-TestInstancesWithCinderVolumes-1695505090 None] Lock "cinder-028298cc-7de1-4465-8de6-6c5bf3f4b4fa-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:30 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:17:30 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=28,cinder:SELECT=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:17:50 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Flow 'volume_create_manager' (d442de8e-6317-48a2-abe9-56b92f8dc682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7fdfda-d181-4124-a301-03fae1e434b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7fdfda-d181-4124-a301-03fae1e434b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-994155464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68925481-d60e-4c3a-b8fb-5aae604cf567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88d7b9c122f4afbaae79efbdd20a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:51Z,use_quota=True,user_id='fe08a0760b064aa4a2073e3a516a005d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa98c2e-d1b9-4d18-9e01-6c5c768ea6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa98c2e-d1b9-4d18-9e01-6c5c768ea6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830bc341-6440-4d8c-9381-18213b12908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830bc341-6440-4d8c-9381-18213b12908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68925481-d60e-4c3a-b8fb-5aae604cf567', 'volume_name': 'volume-68925481-d60e-4c3a-b8fb-5aae604cf567', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b032b0c2-8ddf-45f2-a6ce-6bffd4ef4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b032b0c2-8ddf-45f2-a6ce-6bffd4ef4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358c2a0-d8ec-4c05-b4f4-35e1fb82efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume 68925481-d60e-4c3a-b8fb-5aae604cf567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68925481-d60e-4c3a-b8fb-5aae604cf567', 'volume_size': 1} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-994155464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68925481-d60e-4c3a-b8fb-5aae604cf567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88d7b9c122f4afbaae79efbdd20a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:51Z,use_quota=True,user_id='fe08a0760b064aa4a2073e3a516a005d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Creating volume 68925481-d60e-4c3a-b8fb-5aae604cf567 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:51 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:51 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 1073741824 Apr 30 11:17:51 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Flow 'volume_create_manager' (1e54e060-a71c-4cd0-b8f3-084d21cd0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d35245-9d7e-4c9c-b0a1-f9e29568fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d35245-9d7e-4c9c-b0a1-f9e29568fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1321108339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0952300-08f4-4e3c-8d45-a4f861583185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88d7b9c122f4afbaae79efbdd20a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:51Z,use_quota=True,user_id='fe08a0760b064aa4a2073e3a516a005d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ebca54-4568-4ab4-add3-efa267e1e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ebca54-4568-4ab4-add3-efa267e1e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e661e2ed-848c-4b01-9646-b848e768f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e661e2ed-848c-4b01-9646-b848e768f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0952300-08f4-4e3c-8d45-a4f861583185', 'volume_name': 'volume-c0952300-08f4-4e3c-8d45-a4f861583185', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff925a79-6ee3-429b-8c8f-809055525059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff925a79-6ee3-429b-8c8f-809055525059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5637d81-cf4d-4d6f-8379-b5f0ab1ae495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume c0952300-08f4-4e3c-8d45-a4f861583185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0952300-08f4-4e3c-8d45-a4f861583185', 'volume_size': 1} Apr 30 11:17:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:52 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 1073741824" returned: 0 in 0.910s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:52 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 Apr 30 11:17:52 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:52 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567" returned: 0 in 0.675s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1321108339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0952300-08f4-4e3c-8d45-a4f861583185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88d7b9c122f4afbaae79efbdd20a96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:51Z,use_quota=True,user_id='fe08a0760b064aa4a2073e3a516a005d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Creating volume c0952300-08f4-4e3c-8d45-a4f861583185 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:52 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:52 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 1073741824 Apr 30 11:17:52 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358c2a0-d8ec-4c05-b4f4-35e1fb82efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68925481-d60e-4c3a-b8fb-5aae604cf567', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f94a3-3d11-43aa-be87-e1027e9fd2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume volume-68925481-d60e-4c3a-b8fb-5aae604cf567 (68925481-d60e-4c3a-b8fb-5aae604cf567): created successfully Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f94a3-3d11-43aa-be87-e1027e9fd2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Flow 'volume_create_manager' (d442de8e-6317-48a2-abe9-56b92f8dc682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ab40c6e5-c685-46bc-8b02-cb89b45c5d6a tempest-TestServerVolumeAttachmentScenario-657703787 None] Created volume successfully. Apr 30 11:17:53 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 1073741824" returned: 0 in 0.841s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:53 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 Apr 30 11:17:53 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:54 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185" returned: 0 in 0.676s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5637d81-cf4d-4d6f-8379-b5f0ab1ae495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0952300-08f4-4e3c-8d45-a4f861583185', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf8054d-d89f-4718-bdc3-c0f2f560b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Volume volume-c0952300-08f4-4e3c-8d45-a4f861583185 (c0952300-08f4-4e3c-8d45-a4f861583185): created successfully Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf8054d-d89f-4718-bdc3-c0f2f560b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Flow 'volume_create_manager' (1e54e060-a71c-4cd0-b8f3-084d21cd0f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-56eed13d-8d7b-4be3-9347-000ae2b0c395 tempest-TestServerVolumeAttachmentScenario-657703787 None] Created volume successfully. Apr 30 11:18:04 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:18:04 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:06 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:18:06 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:06 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5708a53f-4c2e-4b7c-84c3-656b840964c7]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:35 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 Apr 30 11:18:35 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:36 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567" returned: 0 in 0.691s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.708s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-68925481-d60e-4c3a-b8fb-5aae604cf567', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64099f59-2ef6-459c-92d0-a9119a369e9f', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:18:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-aedacbd2-1269-43a2-990d-8c0628af2092 req-410c5fbb-59ba-42f8-a033-a1075b76e3ad tempest-TestServerVolumeAttachmentScenario-657703787 None] attachment_update completed successfully. Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32bdd27-2d98-49c2-b1b9-8a60a8e4ad0e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:46 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 Apr 30 11:18:46 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:46 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185" returned: 0 in 0.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a', 'name': 'volume-c0952300-08f4-4e3c-8d45-a4f861583185', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3e90223-1f50-45ad-b0f2-bdb3286f054a', 'enforce_multipath': True} {{(pid=84432) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:18:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-4756729a-8765-4996-83ec-d593f07386a2 req-6038de80-ec8c-4d34-9146-f4450940647f tempest-TestServerVolumeAttachmentScenario-657703787 None] attachment_update completed successfully. Apr 30 11:18:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-ba51c014-c821-48d3-80f6-66df9fd80154 req-987239e0-eb6a-4fb0-884f-c9c2cada1c66 tempest-TestServerVolumeAttachmentScenario-657703787 None] Terminate volume connection completed successfully. Apr 30 11:18:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-ba51c014-c821-48d3-80f6-66df9fd80154 req-987239e0-eb6a-4fb0-884f-c9c2cada1c66 tempest-TestServerVolumeAttachmentScenario-657703787 None] Deleting attachment a3e90223-1f50-45ad-b0f2-bdb3286f054a. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:18:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [req-f74c2da3-8cda-4ce3-b82c-342c928cecc4 req-152cc1ec-0b95-41be-b65b-42b901cf00c7 tempest-TestServerVolumeAttachmentScenario-657703787 None] Terminate volume connection completed successfully. Apr 30 11:18:56 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [req-f74c2da3-8cda-4ce3-b82c-342c928cecc4 req-152cc1ec-0b95-41be-b65b-42b901cf00c7 tempest-TestServerVolumeAttachmentScenario-657703787 None] Deleting attachment 64099f59-2ef6-459c-92d0-a9119a369e9f. {{(pid=84432) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:19:02 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:06 devstack sudo[110460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:06 devstack sudo[110460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "cinder-c0952300-08f4-4e3c-8d45-a4f861583185-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-c0952300-08f4-4e3c-8d45-a4f861583185-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "cinder-quobyte-c0952300-08f4-4e3c-8d45-a4f861583185" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:06 devstack sudo[110460]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-quobyte-c0952300-08f4-4e3c-8d45-a4f861583185" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1e64f-6aa7-487a-9a9a-db1541ac70cc]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:06 devstack sudo[110463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 Apr 30 11:19:06 devstack sudo[110463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:07 devstack sudo[110463]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185" returned: 0 in 0.746s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:07 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185 Apr 30 11:19:07 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:08 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c0952300-08f4-4e3c-8d45-a4f861583185" returned: 0 in 0.583s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-quobyte-c0952300-08f4-4e3c-8d45-a4f861583185" released by "delete_volume" :: held 1.374s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Created reservations ['d505a2af-fbb9-4563-a9f2-017c008f2ea9', '49fff54d-2487-44ff-80db-1282b444d94f', 'c8452a1b-2fe6-4161-8802-293d2864dd49', '158c7f9d-a349-4ac7-b562-cb989f278b32'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:08 devstack sudo[110471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:08 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:08 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.626s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Deleted volume successfully. Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3df8f89a-45d4-4e0e-bfa9-a6382bf4db67 tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-c0952300-08f4-4e3c-8d45-a4f861583185-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "cinder-68925481-d60e-4c3a-b8fb-5aae604cf567-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-68925481-d60e-4c3a-b8fb-5aae604cf567-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "cinder-quobyte-68925481-d60e-4c3a-b8fb-5aae604cf567" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-quobyte-68925481-d60e-4c3a-b8fb-5aae604cf567" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea8485-a7ad-4219-982c-13d9d738d253]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:09 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 Apr 30 11:19:09 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:09 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567" returned: 0 in 0.695s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:09 devstack sudo[110481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567 Apr 30 11:19:09 devstack sudo[110481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:10 devstack sudo[110481]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-68925481-d60e-4c3a-b8fb-5aae604cf567" returned: 0 in 0.659s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-quobyte-68925481-d60e-4c3a-b8fb-5aae604cf567" released by "delete_volume" :: held 1.392s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Created reservations ['c8377af2-6c6c-4827-8f5a-1fcdae57596c', '6ced430e-bf82-41fb-8c54-80f928ac1d08', 'd51e07af-939e-4dbd-a065-933cd4b286fb', '15292339-fcac-4333-8f7b-8cf955862f56'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:10 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:10 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:11 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.633s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:11 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Deleted volume successfully. Apr 30 11:19:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b0dd76b9-17da-405a-8133-1d09e29eedce tempest-TestServerVolumeAttachmentScenario-657703787 None] Lock "cinder-68925481-d60e-4c3a-b8fb-5aae604cf567-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:20 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=20,cinder:SELECT=8,cinder:INSERT=4 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:21 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Flow 'volume_create_manager' (d49bb256-e8e2-44f5-b02e-fe820ffde7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e8649-d45a-48e8-afd4-d6ed7124b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e8649-d45a-48e8-afd4-d6ed7124b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff304699-2f64-42c7-af97-37c734f23a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d594fb14c0f04e378b55a885892a8d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:25Z,use_quota=True,user_id='551f53548af84fd28c10f6e630480787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d9c535-b64b-4634-9e49-d851998151f8),volume_type_id=f6d9c535-b64b-4634-9e49-d851998151f8)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dda17a-f1e6-44dd-84f8-8329decf5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dda17a-f1e6-44dd-84f8-8329decf5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230aabb-5f30-4104-a6aa-c822156dd6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230aabb-5f30-4104-a6aa-c822156dd6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff304699-2f64-42c7-af97-37c734f23a20', 'volume_name': 'volume-ff304699-2f64-42c7-af97-37c734f23a20', 'volume_size': 1, 'image_id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c71f55e5d36b93b59c869df96665ca27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd594fb14c0f04e378b55a885892a8d64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1bac989946e94d2ddc7e72fa32efe07f4c3e9d3c1b9f7e2a19d11c20bf5ec37167df5e9ee1a8688ce17abbcc4fa74051f0f525b72b399e92ac8eb09a23e67243', 'id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'created_at': datetime.datetime(2026, 4, 30, 9, 19, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 19, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be097c1e-b54b-4dbb-89e4-94140ef5281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be097c1e-b54b-4dbb-89e4-94140ef5281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47ae70d-aaf2-474e-81be-2363e9890ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:24 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Volume ff304699-2f64-42c7-af97-37c734f23a20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff304699-2f64-42c7-af97-37c734f23a20', 'volume_size': 1, 'image_id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c71f55e5d36b93b59c869df96665ca27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd594fb14c0f04e378b55a885892a8d64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1bac989946e94d2ddc7e72fa32efe07f4c3e9d3c1b9f7e2a19d11c20bf5ec37167df5e9ee1a8688ce17abbcc4fa74051f0f525b72b399e92ac8eb09a23e67243', 'id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'created_at': datetime.datetime(2026, 4, 30, 9, 19, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 19, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 30 11:19:24 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Trying to clone ff304699-2f64-42c7-af97-37c734f23a20 from image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:19:25 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:19:25 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Image download 0.00 MB at 0.00 MB/s Apr 30 11:19:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd2ee0a-e06d-4c98-8b19-7c15858de9a8]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:25 devstack sudo[110492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:25 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:25 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:25 devstack sudo[110496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:25 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:26 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 1 in 0.700s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:26 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Temporary image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 is fetched for user 551f53548af84fd28c10f6e630480787. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:19:26 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec4e9b-7c4b-4f99-b3fa-d00305db2267]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:26 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:26 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:27 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:27 devstack sudo[110505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:27 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:27 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 1 in 0.618s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff304699-2f64-42c7-af97-37c734f23a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d594fb14c0f04e378b55a885892a8d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:25Z,use_quota=True,user_id='551f53548af84fd28c10f6e630480787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d9c535-b64b-4634-9e49-d851998151f8),volume_type_id=f6d9c535-b64b-4634-9e49-d851998151f8)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Creating volume ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:27 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:27 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1073741824 Apr 30 11:19:27 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:28 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1073741824" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:28 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:28 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:29 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 0 in 0.614s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Attempting download of 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}])) to volume ff304699-2f64-42c7-af97-37c734f23a20. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d310ba0-4054-420e-996a-015457146d5d]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:29 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:29 devstack sudo[110518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb Apr 30 11:19:29 devstack sudo[110518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:30 devstack sudo[110518]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb" returned: 0 in 0.667s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:30 devstack sudo[110523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb Apr 30 11:19:30 devstack sudo[110523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:30 devstack sudo[110523]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb" returned: 1 in 0.646s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_hju73gyb' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a820d189-e9fb-4f2d-bd63-cf66fc1afe14]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:30 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:30 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:31 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:31 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD Apr 30 11:19:31 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:31 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD" returned: 1 in 0.655s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 was raw, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:19:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:32 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:32 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:32 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 0 in 0.712s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:32 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2_74crft3gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:19:32 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Converted 0.00 MB image at 0.00 MB/s Apr 30 11:19:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:32 devstack sudo[110541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1G Apr 30 11:19:32 devstack sudo[110541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:33 devstack sudo[110541]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 1G" returned: 0 in 0.619s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[54445e0a-aa86-47cd-b573-591c1f1094e7]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:33 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:33 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:34 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:34 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:34 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:34 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 1 in 0.683s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Downloaded image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}])) to volume ff304699-2f64-42c7-af97-37c734f23a20 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Temporary image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 for user 551f53548af84fd28c10f6e630480787 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Marking volume ff304699-2f64-42c7-af97-37c734f23a20 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Copying metadata from image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 to ff304699-2f64-42c7-af97-37c734f23a20. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Creating volume glance metadata for volume ff304699-2f64-42c7-af97-37c734f23a20 backed by image 4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c71f55e5d36b93b59c869df96665ca27', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47ae70d-aaf2-474e-81be-2363e9890ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff304699-2f64-42c7-af97-37c734f23a20', 'volume_size': 1, 'image_id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c71f55e5d36b93b59c869df96665ca27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd594fb14c0f04e378b55a885892a8d64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1bac989946e94d2ddc7e72fa32efe07f4c3e9d3c1b9f7e2a19d11c20bf5ec37167df5e9ee1a8688ce17abbcc4fa74051f0f525b72b399e92ac8eb09a23e67243', 'id': '4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2', 'created_at': datetime.datetime(2026, 4, 30, 9, 19, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 19, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e8ca0d3-4e15-4727-bac1-a55a65a5d9c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2588a2d-f1c0-4420-a2eb-bfd79e533262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Volume volume-ff304699-2f64-42c7-af97-37c734f23a20 (ff304699-2f64-42c7-af97-37c734f23a20): created successfully Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2588a2d-f1c0-4420-a2eb-bfd79e533262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Flow 'volume_create_manager' (d49bb256-e8e2-44f5-b02e-fe820ffde7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f6b4dc34-59ba-43c4-a54e-f504105aaa88 tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Created volume successfully. Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Acquiring lock "cinder-ff304699-2f64-42c7-af97-37c734f23a20-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "cinder-ff304699-2f64-42c7-af97-37c734f23a20-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Acquiring lock "cinder-quobyte-ff304699-2f64-42c7-af97-37c734f23a20" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "cinder-quobyte-ff304699-2f64-42c7-af97-37c734f23a20" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[6303da4a-6854-48e3-aeb4-bc44924d16f8]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:35 devstack sudo[110556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:35 devstack sudo[110556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:36 devstack sudo[110556]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 0 in 0.718s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:36 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:36 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:36 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 1 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:19:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:37 devstack sudo[110565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20 Apr 30 11:19:37 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:37 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ff304699-2f64-42c7-af97-37c734f23a20" returned: 0 in 0.595s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "cinder-quobyte-ff304699-2f64-42c7-af97-37c734f23a20" released by "delete_volume" :: held 2.084s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:37 devstack cinder-volume[84432]: WARNING cinder.quota [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:19:37 devstack cinder-volume[84432]: WARNING cinder.quota [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Created reservations ['f0212f4c-0506-48e6-a135-9a1c1f76783f', 'fabbf505-4d1c-48ed-aa9e-db0210668b00', '58c738b1-4479-4825-b46f-0e1fe8f88d43', '581790ff-e452-4ec3-a9ab-e6ce7a34f16b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:37 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:37 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:38 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.584s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:38 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Deleted volume successfully. Apr 30 11:19:38 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-55410d59-e552-425e-9e94-ca23108697bb tempest-VolumeAndVolumeTypeFromImageTest-675322300 None] Lock "cinder-ff304699-2f64-42c7-af97-37c734f23a20-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (21fc93e9-414b-49c4-aa37-95f459552782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc6dd2-a891-45e1-bd03-47f8e896affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cc6dd2-a891-45e1-bd03-47f8e896affc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415110120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c29f979-9c79-4fc6-a342-02f6d49e653e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533daac-eda3-4e02-9492-85bcf6c122e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533daac-eda3-4e02-9492-85bcf6c122e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c46e7e-ae0e-4a23-a9ea-5fe19385fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c46e7e-ae0e-4a23-a9ea-5fe19385fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c29f979-9c79-4fc6-a342-02f6d49e653e', 'volume_name': 'volume-5c29f979-9c79-4fc6-a342-02f6d49e653e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3cc04b-e68b-462d-b408-6c2e6e163b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3cc04b-e68b-462d-b408-6c2e6e163b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d95351a-b9ea-4d57-a2f9-2acaa791525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Volume 5c29f979-9c79-4fc6-a342-02f6d49e653e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c29f979-9c79-4fc6-a342-02f6d49e653e', 'volume_size': 1} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1415110120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c29f979-9c79-4fc6-a342-02f6d49e653e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Creating volume 5c29f979-9c79-4fc6-a342-02f6d49e653e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:42 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:42 devstack sudo[110572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e 1073741824 Apr 30 11:19:42 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (9a6b1e5f-0445-4737-90e8-78f9a53230b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895a6e9e-230b-4ea1-b6c5-03345ee6bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895a6e9e-230b-4ea1-b6c5-03345ee6bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-764243003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7479be85-b88c-4c93-888a-dc29967095ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f4874-9ea5-43ba-859b-0a0a5eefea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f4874-9ea5-43ba-859b-0a0a5eefea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b27224-cb3f-4970-9295-1e92561cab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b27224-cb3f-4970-9295-1e92561cab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7479be85-b88c-4c93-888a-dc29967095ce', 'volume_name': 'volume-7479be85-b88c-4c93-888a-dc29967095ce', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9da37f5-a750-4378-8d4a-712cabe5c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9da37f5-a750-4378-8d4a-712cabe5c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e40986b-2bef-445f-8136-8f8d60fe9f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Volume 7479be85-b88c-4c93-888a-dc29967095ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7479be85-b88c-4c93-888a-dc29967095ce', 'volume_size': 1} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (99574599-995c-42ac-bdc1-a4e161d4d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f338f4e-49ec-44d2-9b8a-7293f669ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f338f4e-49ec-44d2-9b8a-7293f669ca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166380376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddc3cff-11e4-419d-a96b-49dd296f6af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddc3cff-11e4-419d-a96b-49dd296f6af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e610df3b-226a-4c1b-9283-32d5b3f55926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e610df3b-226a-4c1b-9283-32d5b3f55926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c', 'volume_name': 'volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c199dc-4596-497b-94e0-da1866e8033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c199dc-4596-497b-94e0-da1866e8033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b035c48-8b6a-4bc8-ad07-f44be1843b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Volume e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c', 'volume_size': 1} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:43 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e 1073741824" returned: 0 in 0.829s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:43 devstack sudo[110578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e Apr 30 11:19:43 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (82149b02-3f25-4628-901c-052b29fbb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855777af-731d-49a4-8754-778eb925b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855777af-731d-49a4-8754-778eb925b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1752126585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d407b469-1bfb-44d2-8477-72a772f34d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:44Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b5bab7-b7dd-4c4d-bbc3-41ade1d04b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b5bab7-b7dd-4c4d-bbc3-41ade1d04b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcf1576-fcf5-468f-9722-94092cfdb873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcf1576-fcf5-468f-9722-94092cfdb873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd407b469-1bfb-44d2-8477-72a772f34d61', 'volume_name': 'volume-d407b469-1bfb-44d2-8477-72a772f34d61', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4447-b9f0-438b-aa04-3ba3554c98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4447-b9f0-438b-aa04-3ba3554c98a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b8306b-ab76-46c0-9eb4-c7eabc0a3344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Volume d407b469-1bfb-44d2-8477-72a772f34d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d407b469-1bfb-44d2-8477-72a772f34d61', 'volume_size': 1} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:43 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (55156c19-4b1a-4681-a359-2d40a54412df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6490af-6edd-4b31-b977-7fed383609f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6490af-6edd-4b31-b977-7fed383609f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733394034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e879b-e278-463f-9cc8-95e539cd1132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:44Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320f4e22-e986-45ca-9323-ee553344ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320f4e22-e986-45ca-9323-ee553344ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd99b36f-6a37-4fc0-8a22-57e5a42dcbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd99b36f-6a37-4fc0-8a22-57e5a42dcbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7e879b-e278-463f-9cc8-95e539cd1132', 'volume_name': 'volume-fc7e879b-e278-463f-9cc8-95e539cd1132', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2fb11e-7731-4c29-89f9-ca550cebec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2fb11e-7731-4c29-89f9-ca550cebec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372fdaa6-7564-4e89-a535-18cd53189137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Volume fc7e879b-e278-463f-9cc8-95e539cd1132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7e879b-e278-463f-9cc8-95e539cd1132', 'volume_size': 1} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:44 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e" returned: 0 in 0.599s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-764243003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7479be85-b88c-4c93-888a-dc29967095ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Creating volume 7479be85-b88c-4c93-888a-dc29967095ce {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:44 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d95351a-b9ea-4d57-a2f9-2acaa791525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c29f979-9c79-4fc6-a342-02f6d49e653e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack sudo[110581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce 1073741824 Apr 30 11:19:44 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a398b3e-b0f5-48b6-bcd0-28b47e4df946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Volume volume-5c29f979-9c79-4fc6-a342-02f6d49e653e (5c29f979-9c79-4fc6-a342-02f6d49e653e): created successfully Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a398b3e-b0f5-48b6-bcd0-28b47e4df946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (21fc93e9-414b-49c4-aa37-95f459552782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fcfc0ce6-b6f3-4c98-a886-a058391cc382 tempest-CreateVolumesFromImageTest-373764883 None] Created volume successfully. Apr 30 11:19:44 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce 1073741824" returned: 0 in 0.728s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:44 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce Apr 30 11:19:44 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:45 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce" returned: 0 in 0.555s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166380376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:43Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Creating volume e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:45 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:45 devstack sudo[110591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c 1073741824 Apr 30 11:19:45 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e40986b-2bef-445f-8136-8f8d60fe9f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7479be85-b88c-4c93-888a-dc29967095ce', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78435c-386d-4674-9389-67c373f3213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:45 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Volume volume-7479be85-b88c-4c93-888a-dc29967095ce (7479be85-b88c-4c93-888a-dc29967095ce): created successfully Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78435c-386d-4674-9389-67c373f3213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:45 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (9a6b1e5f-0445-4737-90e8-78f9a53230b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d8cf5f17-f44b-4230-b43f-d57e145f9289 tempest-CreateVolumesFromImageTest-373764883 None] Created volume successfully. Apr 30 11:19:46 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c 1073741824" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:46 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c Apr 30 11:19:46 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:46 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" returned: 0 in 0.563s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1752126585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d407b469-1bfb-44d2-8477-72a772f34d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:44Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Creating volume d407b469-1bfb-44d2-8477-72a772f34d61 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:46 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b035c48-8b6a-4bc8-ad07-f44be1843b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:46 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 1073741824 Apr 30 11:19:46 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6f60f2-3a48-4db8-b93d-4d83a1ec05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Volume volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c (e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c): created successfully Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6f60f2-3a48-4db8-b93d-4d83a1ec05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (99574599-995c-42ac-bdc1-a4e161d4d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7b0ec005-27d2-4657-b82f-9fbc60fd1429 tempest-CreateVolumesFromImageTest-373764883 None] Created volume successfully. Apr 30 11:19:47 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 1073741824" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:47 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 Apr 30 11:19:47 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:48 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61" returned: 0 in 0.559s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.214s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733394034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e879b-e278-463f-9cc8-95e539cd1132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c66b16fe4e4027a067f911f16694a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:19:44Z,use_quota=True,user_id='3faf583d0209453ba555871f282e753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Creating volume fc7e879b-e278-463f-9cc8-95e539cd1132 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:19:48 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b8306b-ab76-46c0-9eb4-c7eabc0a3344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d407b469-1bfb-44d2-8477-72a772f34d61', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:48 devstack sudo[110609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 1073741824 Apr 30 11:19:48 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef107e8b-6755-4d10-b654-025dd17de38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:48 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Volume volume-d407b469-1bfb-44d2-8477-72a772f34d61 (d407b469-1bfb-44d2-8477-72a772f34d61): created successfully Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef107e8b-6755-4d10-b654-025dd17de38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:48 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (82149b02-3f25-4628-901c-052b29fbb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e9e321e5-431c-44f0-a625-39b007aa31d0 tempest-CreateVolumesFromImageTest-373764883 None] Created volume successfully. Apr 30 11:19:49 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 1073741824" returned: 0 in 0.733s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:49 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 Apr 30 11:19:49 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:49 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132" returned: 0 in 0.563s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372fdaa6-7564-4e89-a535-18cd53189137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7e879b-e278-463f-9cc8-95e539cd1132', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea242b78-aa0b-44d5-bae9-9a5cda63bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:19:49 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Volume volume-fc7e879b-e278-463f-9cc8-95e539cd1132 (fc7e879b-e278-463f-9cc8-95e539cd1132): created successfully Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea242b78-aa0b-44d5-bae9-9a5cda63bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:19:49 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Flow 'volume_create_manager' (55156c19-4b1a-4681-a359-2d40a54412df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:19:49 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-580efbe6-12ca-4a25-85d8-d61e5d76bab6 tempest-CreateVolumesFromImageTest-373764883 None] Created volume successfully. Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-fc7e879b-e278-463f-9cc8-95e539cd1132-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-fc7e879b-e278-463f-9cc8-95e539cd1132-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-quobyte-fc7e879b-e278-463f-9cc8-95e539cd1132" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-fc7e879b-e278-463f-9cc8-95e539cd1132" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec1638-8d8e-46a1-b1ed-665818c7e0ff]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:50 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 Apr 30 11:19:50 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:51 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132" returned: 0 in 0.716s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:51 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132 Apr 30 11:19:51 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:51 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-fc7e879b-e278-463f-9cc8-95e539cd1132" returned: 0 in 0.578s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-fc7e879b-e278-463f-9cc8-95e539cd1132" released by "delete_volume" :: held 1.335s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Created reservations ['9a28163f-a4b2-4a9c-9a42-d68c2a6c4727', '93918d58-af50-45e5-8346-947e35417587', '9f97bed4-8f27-49d8-9abc-96243d42b9f3', '2dbc436d-e11f-4ba4-b389-85321cc55f37'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:52 devstack sudo[110626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:52 devstack sudo[110626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:52 devstack sudo[110626]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.563s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Deleted volume successfully. Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-083aa454-ffce-4959-8bc5-ae3400cd217d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-fc7e879b-e278-463f-9cc8-95e539cd1132-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-d407b469-1bfb-44d2-8477-72a772f34d61-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-d407b469-1bfb-44d2-8477-72a772f34d61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-quobyte-d407b469-1bfb-44d2-8477-72a772f34d61" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-d407b469-1bfb-44d2-8477-72a772f34d61" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746aabf-d341-4742-9f30-a3209db0d66d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:52 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 Apr 30 11:19:52 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:53 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61" returned: 0 in 0.671s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:53 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61 Apr 30 11:19:53 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:54 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-d407b469-1bfb-44d2-8477-72a772f34d61" returned: 0 in 0.570s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-d407b469-1bfb-44d2-8477-72a772f34d61" released by "delete_volume" :: held 1.279s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Created reservations ['712f78f4-fd07-4a19-8eb9-c616b41f1228', '2f9aedca-02e9-4bea-9920-2ac5c4b6c433', '4b1d6cc9-9dfa-4437-9d29-ec457da672a0', '7bb8403d-055a-4280-b950-8bdf19536891'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:54 devstack sudo[110637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:54 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:54 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.580s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:54 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Deleted volume successfully. Apr 30 11:19:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8f292bf6-8c25-4a62-82f1-9a554f0b4a9d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-d407b469-1bfb-44d2-8477-72a772f34d61-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-quobyte-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eb35e4-4a55-4346-9f2d-620f676ae30a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:55 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c Apr 30 11:19:55 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:55 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" returned: 0 in 0.700s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:55 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c Apr 30 11:19:55 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:56 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" returned: 0 in 0.582s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c" released by "delete_volume" :: held 1.325s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Created reservations ['b6d694c3-b297-485c-9475-3ece63787aa2', '4b711e51-f48a-492d-8ff2-843e968e9ef8', 'b75eee2e-5254-4efb-865a-3c7d1dd7d5a3', '207fc428-5654-4fcf-a758-d45f1c6f7365'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:56 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:56 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:57 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.558s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:57 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Deleted volume successfully. Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-86304837-a328-4dd4-aec4-7cdfb6d54f6d tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-e0d8b1c2-7e37-4f9f-883e-e7e0a60f363c-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-7479be85-b88c-4c93-888a-dc29967095ce-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-7479be85-b88c-4c93-888a-dc29967095ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-quobyte-7479be85-b88c-4c93-888a-dc29967095ce" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-7479be85-b88c-4c93-888a-dc29967095ce" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae5a99-573b-46c3-bde5-ba93b65c0d6b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:57 devstack sudo[110662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce Apr 30 11:19:57 devstack sudo[110662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:58 devstack sudo[110662]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce" returned: 0 in 0.700s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:58 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce Apr 30 11:19:58 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:58 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7479be85-b88c-4c93-888a-dc29967095ce" returned: 0 in 0.579s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-7479be85-b88c-4c93-888a-dc29967095ce" released by "delete_volume" :: held 1.319s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Created reservations ['58c8bc41-9ca0-4e2b-8493-1186ab8cc693', '255f5e1a-6b14-4978-9ce3-62036db4f5eb', '5666b3fa-b38c-4e6e-843f-98e7a03c131e', 'f6b2285f-4564-44ca-9bf1-85c0d631f704'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:58 devstack sudo[110672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:19:58 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:59 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.594s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:19:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Deleted volume successfully. Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-37fe491d-7df6-477d-a238-3f195883c81b tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-7479be85-b88c-4c93-888a-dc29967095ce-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-5c29f979-9c79-4fc6-a342-02f6d49e653e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-5c29f979-9c79-4fc6-a342-02f6d49e653e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "cinder-quobyte-5c29f979-9c79-4fc6-a342-02f6d49e653e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-5c29f979-9c79-4fc6-a342-02f6d49e653e" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a85a9-8982-4446-959c-453076318f2b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:19:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:59 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e Apr 30 11:19:59 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:00 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:00 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e Apr 30 11:20:00 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:00 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-5c29f979-9c79-4fc6-a342-02f6d49e653e" returned: 0 in 0.562s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-quobyte-5c29f979-9c79-4fc6-a342-02f6d49e653e" released by "delete_volume" :: held 1.292s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Created reservations ['85ae59a8-c604-4d32-9fa6-24fb9f5af6bb', '391d7b24-170d-441c-bf37-c2deaab85a14', '83617383-b4de-44a7-b1af-be54ffa275ab', 'cd9ffc53-3680-4ca2-843e-d4a5a2a9d30d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:00 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:00 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:01 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.552s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:01 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:01 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Deleted volume successfully. Apr 30 11:20:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-8c83ac20-46b0-4242-a600-9387369ac022 tempest-CreateVolumesFromImageTest-373764883 None] Lock "cinder-5c29f979-9c79-4fc6-a342-02f6d49e653e-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Flow 'volume_create_manager' (93ccf608-07bd-4ee2-a212-5ed2b0323a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d4ba4-15e1-4ef1-b8da-a67979bd4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d4ba4-15e1-4ef1-b8da-a67979bd4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f42362-5717-4ede-9d0d-6c97a9ec3f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45698ef9f2274be49963a0981b0cba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:04Z,use_quota=True,user_id='0f634429eb4a4a93a435964b12315dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cadad8-0a79-4366-b6ec-c2522cdbe69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cadad8-0a79-4366-b6ec-c2522cdbe69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9c3cb-984c-4cd1-a4ad-89d407ce08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9c3cb-984c-4cd1-a4ad-89d407ce08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f42362-5717-4ede-9d0d-6c97a9ec3f09', 'volume_name': 'volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a9d4b0-8554-4a91-8ecd-6277209c6706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a9d4b0-8554-4a91-8ecd-6277209c6706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66466172-3543-45ea-bc24-f4b6688e9c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Volume 62f42362-5717-4ede-9d0d-6c97a9ec3f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09', 'volume_size': 1} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f42362-5717-4ede-9d0d-6c97a9ec3f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45698ef9f2274be49963a0981b0cba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:04Z,use_quota=True,user_id='0f634429eb4a4a93a435964b12315dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Creating volume 62f42362-5717-4ede-9d0d-6c97a9ec3f09 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:04 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:04 devstack sudo[110726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 1073741824 Apr 30 11:20:04 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:05 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 1073741824" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:05 devstack sudo[110733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 Apr 30 11:20:05 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:05 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66466172-3543-45ea-bc24-f4b6688e9c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21505d3c-b6c7-41c3-a99b-2104f8dc820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:05 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Volume volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 (62f42362-5717-4ede-9d0d-6c97a9ec3f09): created successfully Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21505d3c-b6c7-41c3-a99b-2104f8dc820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:05 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Flow 'volume_create_manager' (93ccf608-07bd-4ee2-a212-5ed2b0323a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-11161180-f316-4fa3-81a5-79677ed2835c tempest-CinderUnicodeTest-855398903 None] Created volume successfully. Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:06 devstack sudo[110736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:06 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:06 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.577s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Flow 'volume_create_manager' (bdb34651-cdcc-4f3e-8b13-9f8e8c18401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9d184e-6eb6-4348-83fd-029c30c3322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9d184e-6eb6-4348-83fd-029c30c3322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-749373625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f626bb-290c-4f33-9cfd-a88db05959d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45698ef9f2274be49963a0981b0cba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:07Z,use_quota=True,user_id='0f634429eb4a4a93a435964b12315dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d6aa80-2ef0-4862-9172-0f90376f83df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d6aa80-2ef0-4862-9172-0f90376f83df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ab1958-6aa4-4175-bc6f-248add6a7b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ab1958-6aa4-4175-bc6f-248add6a7b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f626bb-290c-4f33-9cfd-a88db05959d5', 'volume_name': 'volume-f1f626bb-290c-4f33-9cfd-a88db05959d5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824743f1-3911-4f99-871a-475f5453b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824743f1-3911-4f99-871a-475f5453b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d683c62e-142b-4a8a-9336-426854de7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:06 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Volume f1f626bb-290c-4f33-9cfd-a88db05959d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f626bb-290c-4f33-9cfd-a88db05959d5', 'volume_size': 1} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-749373625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f626bb-290c-4f33-9cfd-a88db05959d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45698ef9f2274be49963a0981b0cba92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:07Z,use_quota=True,user_id='0f634429eb4a4a93a435964b12315dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Creating volume f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:06 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:06 devstack sudo[110739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 1073741824 Apr 30 11:20:06 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:07 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 1073741824" returned: 0 in 0.748s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:07 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 Apr 30 11:20:07 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:08 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d683c62e-142b-4a8a-9336-426854de7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f626bb-290c-4f33-9cfd-a88db05959d5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f54f4a3-b0a2-412d-907e-af74f59db8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:08 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Volume volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 (f1f626bb-290c-4f33-9cfd-a88db05959d5): created successfully Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f54f4a3-b0a2-412d-907e-af74f59db8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:08 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Flow 'volume_create_manager' (bdb34651-cdcc-4f3e-8b13-9f8e8c18401c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4830136d-9227-46fe-9a31-bde1d938f0b1 tempest-CinderUnicodeTest-855398903 None] Created volume successfully. Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Creating offline snapshot 9c7bc8f8-697c-4baa-bba8-b6198df52408 of volume f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb70e0-76d8-4c6e-a872-30e03b3c271e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:09 devstack sudo[110748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 Apr 30 11:20:09 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:09 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5" returned: 0 in 0.698s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:09 devstack sudo[110754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 1G Apr 30 11:20:09 devstack sudo[110754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:10 devstack sudo[110754]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 1G" returned: 0 in 0.706s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:10 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 Apr 30 11:20:10 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:11 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408" returned: 0 in 0.610s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:11 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 is being set with open permissions: ugo+rw Apr 30 11:20:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:11 devstack sudo[110764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 Apr 30 11:20:11 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:11 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:11 devstack sudo[110767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info Apr 30 11:20:11 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:12 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info" returned: 0 in 0.557s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:12 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info is being set with open permissions: ugo+rw Apr 30 11:20:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:12 devstack sudo[110770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info Apr 30 11:20:12 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:12 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.info" returned: 0 in 0.549s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.773s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9064d69a-ca07-4c6b-84a6-c18dff865d05 tempest-CinderUnicodeTest-855398903 None] Create snapshot completed successfully Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-9c7bc8f8-697c-4baa-bba8-b6198df52408-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-9c7bc8f8-697c-4baa-bba8-b6198df52408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-quobyte-9c7bc8f8-697c-4baa-bba8-b6198df52408" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-9c7bc8f8-697c-4baa-bba8-b6198df52408" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Deleting offline snapshot 9c7bc8f8-697c-4baa-bba8-b6198df52408 of volume f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] snapshot_file for this snap is: volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89bafc1-ac4a-4abe-8ec5-cc572ac4a429]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:13 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 Apr 30 11:20:13 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:14 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1f626bb-290c-4f33-9cfd-a88db05959d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[240bf8e8-929e-4513-99b5-268a404685e0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:14 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 Apr 30 11:20:14 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:14 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5" returned: 0 in 0.672s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:14 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 Apr 30 11:20:14 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:15 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408" returned: 0 in 0.622s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:15 devstack sudo[110788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408 Apr 30 11:20:15 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:15 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5.9c7bc8f8-697c-4baa-bba8-b6198df52408" returned: 0 in 0.563s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-9c7bc8f8-697c-4baa-bba8-b6198df52408" released by "_delete_snapshot" :: held 2.609s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" released by "delete_snapshot" :: held 2.630s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Created reservations ['c2e55ff5-a628-434e-b804-06a45f52ea9d', 'a985058e-783f-465e-a43b-7fcccfb86785', '94d4a77b-86d3-4b1e-b9c9-d42d0154f7ec', 'f5e27c82-0a39-4bbf-a196-983bd9421ecf'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:16 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Delete snapshot completed successfully. Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7e9db84-d69c-4661-a323-f26f4d190031 tempest-CinderUnicodeTest-855398903 None] Lock "cinder-9c7bc8f8-697c-4baa-bba8-b6198df52408-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-f1f626bb-290c-4f33-9cfd-a88db05959d5-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "cinder-f1f626bb-290c-4f33-9cfd-a88db05959d5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" acquired by "delete_volume" :: waited 0.013s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d532934-b845-44ed-8b72-7e397d641639]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:16 devstack sudo[110791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 Apr 30 11:20:16 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:17 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5" returned: 0 in 0.650s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:17 devstack sudo[110796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5 Apr 30 11:20:17 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:17 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-f1f626bb-290c-4f33-9cfd-a88db05959d5" returned: 0 in 0.565s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-f1f626bb-290c-4f33-9cfd-a88db05959d5" released by "delete_volume" :: held 1.267s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Created reservations ['79cd6ac3-5272-4897-b0c4-c03a07fc8f94', '4580c816-646a-4275-80ea-7a005fa60ba9', '136d4d05-eba7-47de-9683-82e32164288a', '2879c05d-d80c-4a28-b974-e1aecd86397d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:18 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:18 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:18 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.552s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:18 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Deleted volume successfully. Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b8e7c7f7-1d4c-4194-bb5c-43b62a99240f tempest-CinderUnicodeTest-855398903 None] Lock "cinder-f1f626bb-290c-4f33-9cfd-a88db05959d5-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-62f42362-5717-4ede-9d0d-6c97a9ec3f09-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "cinder-62f42362-5717-4ede-9d0d-6c97a9ec3f09-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Acquiring lock "cinder-quobyte-62f42362-5717-4ede-9d0d-6c97a9ec3f09" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-62f42362-5717-4ede-9d0d-6c97a9ec3f09" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc89c4b-baf4-4127-b3d0-8f257da07f15]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:18 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 Apr 30 11:20:18 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:19 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09" returned: 0 in 0.656s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:19 devstack sudo[110807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09 Apr 30 11:20:19 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:20 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-62f42362-5717-4ede-9d0d-6c97a9ec3f09" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "cinder-quobyte-62f42362-5717-4ede-9d0d-6c97a9ec3f09" released by "delete_volume" :: held 1.288s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Created reservations ['7c1394a8-2621-4738-b19d-5d098a220a46', 'd3e16a07-0984-4d6b-959e-da97161f8046', '12305548-af9b-4597-ad58-d2e3059fab6a', '96023656-5860-4775-9bbb-3df06dcc0da5'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:20 devstack sudo[110811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:20 devstack sudo[110811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:20 devstack sudo[110811]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.576s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Deleted volume successfully. Apr 30 11:20:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-c7ca615b-3309-4c2e-9262-baedfb89bfab tempest-CinderUnicodeTest-855398903 None] Lock "cinder-62f42362-5717-4ede-9d0d-6c97a9ec3f09-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:30 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=73,cinder:UPDATE=91,cinder:INSERT=28,cinder:DELETE=9 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:20:30 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=102,cinder:SELECT=69,cinder:INSERT=27,cinder:DELETE=8 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (7c318822-9ef4-405f-95f1-57016bb24014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d5e571-d376-4ecf-a5a7-731c477d6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d5e571-d376-4ecf-a5a7-731c477d6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126293567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75304acd-9e2d-43d4-ae1e-6c48f3843579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:32Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031dc486-ec63-4bc7-931f-f55e7f8513b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031dc486-ec63-4bc7-931f-f55e7f8513b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d311dd-a982-4bc4-8bd1-5b220dab5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d311dd-a982-4bc4-8bd1-5b220dab5879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75304acd-9e2d-43d4-ae1e-6c48f3843579', 'volume_name': 'volume-75304acd-9e2d-43d4-ae1e-6c48f3843579', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7d4084-dc04-428a-aa38-6e710e2b70c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7d4084-dc04-428a-aa38-6e710e2b70c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392b3ecc-a3ab-4d5b-a7e5-c338e9ed92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Volume 75304acd-9e2d-43d4-ae1e-6c48f3843579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75304acd-9e2d-43d4-ae1e-6c48f3843579', 'volume_size': 1} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126293567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75304acd-9e2d-43d4-ae1e-6c48f3843579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:32Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Creating volume 75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:32 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:32 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 1073741824 Apr 30 11:20:32 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (1a60fa88-1206-4a98-a765-01dab39ce759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a905a5-1e64-4dfe-a543-74edbc988719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a905a5-1e64-4dfe-a543-74edbc988719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176415256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac45017-e1cd-43d0-93a2-cf66516cf871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:32Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b51caaf-04de-4453-88e9-3d6ffad80230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b51caaf-04de-4453-88e9-3d6ffad80230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555e74e-cce0-4573-a125-dc265743444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555e74e-cce0-4573-a125-dc265743444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac45017-e1cd-43d0-93a2-cf66516cf871', 'volume_name': 'volume-1ac45017-e1cd-43d0-93a2-cf66516cf871', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed23e32-bbac-4c73-86d6-7f1cd6ff0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed23e32-bbac-4c73-86d6-7f1cd6ff0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86f1186-1abf-473d-8e61-68f78ad9d5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:32 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume 1ac45017-e1cd-43d0-93a2-cf66516cf871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac45017-e1cd-43d0-93a2-cf66516cf871', 'volume_size': 1} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:32 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (ca1fcdfe-b491-4b36-b7d0-1de9b0e4bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e00ca6-f01e-4be6-a372-68503eafe767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e00ca6-f01e-4be6-a372-68503eafe767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472019250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411d239a-892d-49b2-b181-1dd0adb724d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:33Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af3b714-24e8-414f-b4f3-d4e387db5d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af3b714-24e8-414f-b4f3-d4e387db5d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b3687-3e3d-42eb-af9b-a4654a89b870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b3687-3e3d-42eb-af9b-a4654a89b870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411d239a-892d-49b2-b181-1dd0adb724d5', 'volume_name': 'volume-411d239a-892d-49b2-b181-1dd0adb724d5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82340d-f3b9-43c9-9375-92266f77ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82340d-f3b9-43c9-9375-92266f77ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ca8203-ea3a-4e15-ad17-e84858770bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Volume 411d239a-892d-49b2-b181-1dd0adb724d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411d239a-892d-49b2-b181-1dd0adb724d5', 'volume_size': 1} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (02164ba0-c783-4a6a-9766-fb363ca7e805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0bb645-9fd6-462a-a003-40967e78a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0bb645-9fd6-462a-a003-40967e78a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582026401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8550517c-aa79-442e-9680-9ec8087efe7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:33Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28897b06-1a05-4871-bb0f-9469b7b388f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28897b06-1a05-4871-bb0f-9469b7b388f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7065b56b-c738-4906-b695-5ee27ab69c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7065b56b-c738-4906-b695-5ee27ab69c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8550517c-aa79-442e-9680-9ec8087efe7e', 'volume_name': 'volume-8550517c-aa79-442e-9680-9ec8087efe7e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920bf70a-a6ac-484a-a9a0-8a362e61c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920bf70a-a6ac-484a-a9a0-8a362e61c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61233327-db8c-4225-902a-7daf911ea81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Volume 8550517c-aa79-442e-9680-9ec8087efe7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8550517c-aa79-442e-9680-9ec8087efe7e', 'volume_size': 1} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:33 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 1073741824" returned: 0 in 1.033s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:33 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:20:33 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (6c5e3050-e7a4-4193-b6d2-56ae6ceeb698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc17a293-dd82-4417-8d6c-12b7144fd842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc17a293-dd82-4417-8d6c-12b7144fd842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540272325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8315e618-4073-429e-8b9c-86f26c5cdad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:34Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2571be-404a-4ed1-a0a0-21ff0355e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2571be-404a-4ed1-a0a0-21ff0355e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc1595-780e-416f-aca9-f5070791f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cc1595-780e-416f-aca9-f5070791f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8315e618-4073-429e-8b9c-86f26c5cdad4', 'volume_name': 'volume-8315e618-4073-429e-8b9c-86f26c5cdad4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccaabeb-0dc9-4b19-af39-ee467cea9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccaabeb-0dc9-4b19-af39-ee467cea9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d06363a-d3c5-4014-a62e-5d2a1c2f73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:33 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Volume 8315e618-4073-429e-8b9c-86f26c5cdad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8315e618-4073-429e-8b9c-86f26c5cdad4', 'volume_size': 1} Apr 30 11:20:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (9aa86f34-ba6f-4c61-b45d-175633d619dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5fc243-d6f2-40b3-8a0f-0807798d775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5fc243-d6f2-40b3-8a0f-0807798d775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980724014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef7fa61-c807-45f7-b546-0775545fc5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:34Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a12e8-e220-4158-9f94-9c05227b00af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a12e8-e220-4158-9f94-9c05227b00af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebeee53-6379-41f5-9725-adba61df4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebeee53-6379-41f5-9725-adba61df4444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef7fa61-c807-45f7-b546-0775545fc5e5', 'volume_name': 'volume-2ef7fa61-c807-45f7-b546-0775545fc5e5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf43cb13-7c27-441a-b2cc-0a0ce798e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf43cb13-7c27-441a-b2cc-0a0ce798e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4167a3-d96b-4ff5-b5c0-04f5ff6f13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Volume 2ef7fa61-c807-45f7-b546-0775545fc5e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef7fa61-c807-45f7-b546-0775545fc5e5', 'volume_size': 1} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:34 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176415256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac45017-e1cd-43d0-93a2-cf66516cf871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:32Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume 1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:34 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392b3ecc-a3ab-4d5b-a7e5-c338e9ed92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75304acd-9e2d-43d4-ae1e-6c48f3843579', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019646c9-5ca8-494f-a13a-dcc0bbbe0b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack sudo[110861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 1073741824 Apr 30 11:20:34 devstack sudo[110861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Volume volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 (75304acd-9e2d-43d4-ae1e-6c48f3843579): created successfully Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019646c9-5ca8-494f-a13a-dcc0bbbe0b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (7c318822-9ef4-405f-95f1-57016bb24014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-c6302756-39d2-4c9c-8eed-993337e74e22 tempest-VolumeDependencyTests-496657999 None] Created volume successfully. Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (8cf388c6-666f-46ab-a4e1-e275f5f5e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b0d2fc-57bb-43cb-bc23-457445062fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b0d2fc-57bb-43cb-bc23-457445062fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248473219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9ae661-9d84-4478-843d-b405d7cda0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:35Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972a444-dfa9-418b-9c10-4dd091328964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972a444-dfa9-418b-9c10-4dd091328964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ca3a97-2605-4a99-b6b4-e6f5857a8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ca3a97-2605-4a99-b6b4-e6f5857a8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9ae661-9d84-4478-843d-b405d7cda0bf', 'volume_name': 'volume-ee9ae661-9d84-4478-843d-b405d7cda0bf', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155380f9-41d5-4097-a4cc-bf519ea6a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155380f9-41d5-4097-a4cc-bf519ea6a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5615f56-be69-4bd2-95da-d93f466620ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Volume ee9ae661-9d84-4478-843d-b405d7cda0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9ae661-9d84-4478-843d-b405d7cda0bf', 'volume_size': 1} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:35 devstack sudo[110861]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 1073741824" returned: 0 in 0.916s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:35 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 Apr 30 11:20:35 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:35 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871" returned: 0 in 0.614s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.828s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472019250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411d239a-892d-49b2-b181-1dd0adb724d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:33Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Creating volume 411d239a-892d-49b2-b181-1dd0adb724d5 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:35 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:36 devstack sudo[110869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 1073741824 Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86f1186-1abf-473d-8e61-68f78ad9d5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac45017-e1cd-43d0-93a2-cf66516cf871', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360a5ab-a6f2-4ded-b7d5-fbd1225837ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 (1ac45017-e1cd-43d0-93a2-cf66516cf871): created successfully Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360a5ab-a6f2-4ded-b7d5-fbd1225837ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (1a60fa88-1206-4a98-a765-01dab39ce759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0edc8db9-c670-457f-81e8-de94c17f26a0 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Flow 'volume_create_manager' (bfe2fd1b-b4a3-4f82-9e5a-8dd50c141b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4df104-020d-496b-a5a4-862385ecab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4df104-020d-496b-a5a4-862385ecab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec763fe-a44a-42d8-ae33-06ca9dc34e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4878f7e1e32246ca8253f3f7e31c3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:36Z,use_quota=True,user_id='857ee648d8cf4c04983342a30fd0f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11866e32-3fb0-472a-a2a6-b2ab59f362bb),volume_type_id=11866e32-3fb0-472a-a2a6-b2ab59f362bb)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31b346d-b6b0-4a9a-8e29-89c76aa5671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31b346d-b6b0-4a9a-8e29-89c76aa5671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6166d1-3c7a-477f-a9aa-9af876a560d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:20:36 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 1073741824" returned: 0 in 0.801s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6166d1-3c7a-477f-a9aa-9af876a560d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ec763fe-a44a-42d8-ae33-06ca9dc34e33', 'volume_name': 'volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33', 'volume_size': 1, 'image_id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a13192fc3757aafd8751eeec10ba7792', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4878f7e1e32246ca8253f3f7e31c3068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f5486d54f86e71046a31bb1fe03d1a3c34d5243ed3af198b835e73830a4820321e053f4f01ec1ecb065879f7ce8660832b5e09aad631d1057478c9eb58f34', 'id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'created_at': datetime.datetime(2026, 4, 30, 9, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d840490f-8a5a-4393-8f1f-d648b4600fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d840490f-8a5a-4393-8f1f-d648b4600fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83031b74-efec-4129-90b8-27ce6af385f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33', 'volume_size': 1, 'image_id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a13192fc3757aafd8751eeec10ba7792', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4878f7e1e32246ca8253f3f7e31c3068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f5486d54f86e71046a31bb1fe03d1a3c34d5243ed3af198b835e73830a4820321e053f4f01ec1ecb065879f7ce8660832b5e09aad631d1057478c9eb58f34', 'id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'created_at': datetime.datetime(2026, 4, 30, 9, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Trying to clone 1ec763fe-a44a-42d8-ae33-06ca9dc34e33 from image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:36 devstack sudo[110875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 Apr 30 11:20:36 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:36 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:20:36 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Image download 0.00 MB at 0.00 MB/s Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f465a5-dd50-494c-8fa1-a715449479f1]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:37 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:37 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:37 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5" returned: 0 in 0.630s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.033s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582026401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8550517c-aa79-442e-9680-9ec8087efe7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:33Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Creating volume 8550517c-aa79-442e-9680-9ec8087efe7e {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:37 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:37 devstack sudo[110880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e 1073741824 Apr 30 11:20:37 devstack sudo[110880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ca8203-ea3a-4e15-ad17-e84858770bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411d239a-892d-49b2-b181-1dd0adb724d5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1079d025-a7a5-4e1d-851e-68052050f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:37 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Volume volume-411d239a-892d-49b2-b181-1dd0adb724d5 (411d239a-892d-49b2-b181-1dd0adb724d5): created successfully Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1079d025-a7a5-4e1d-851e-68052050f66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (ca1fcdfe-b491-4b36-b7d0-1de9b0e4bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-90586d14-851e-4801-acb8-bffd0fc78517 tempest-CreateVolumesFromImageTest-569924808 None] Created volume successfully. Apr 30 11:20:37 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:37 devstack sudo[110884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:37 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:38 devstack sudo[110880]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e 1073741824" returned: 0 in 0.768s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:38 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e Apr 30 11:20:38 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:38 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 1 in 0.667s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Temporary image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 is fetched for user 857ee648d8cf4c04983342a30fd0f844. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac557c7a-e836-4e4a-9c54-f1a3ee62d1d0]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:38 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:38 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:38 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.967s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540272325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8315e618-4073-429e-8b9c-86f26c5cdad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:34Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Creating volume 8315e618-4073-429e-8b9c-86f26c5cdad4 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:38 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61233327-db8c-4225-902a-7daf911ea81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8550517c-aa79-442e-9680-9ec8087efe7e', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:38 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 1073741824 Apr 30 11:20:38 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586c63c4-289a-4eb6-af28-1621ab127b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:38 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Volume volume-8550517c-aa79-442e-9680-9ec8087efe7e (8550517c-aa79-442e-9680-9ec8087efe7e): created successfully Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586c63c4-289a-4eb6-af28-1621ab127b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (02164ba0-c783-4a6a-9766-fb363ca7e805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6fcfbb04-4b3f-4829-a9ce-d84e9c429dd2 tempest-CreateVolumesFromImageTest-569924808 None] Created volume successfully. Apr 30 11:20:39 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:39 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:39 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:39 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 1073741824" returned: 0 in 0.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:39 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 Apr 30 11:20:39 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:39 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 1 in 0.690s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:20:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:40 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4" returned: 0 in 0.562s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.982s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980724014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef7fa61-c807-45f7-b546-0775545fc5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:34Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Creating volume 2ef7fa61-c807-45f7-b546-0775545fc5e5 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:40 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d06363a-d3c5-4014-a62e-5d2a1c2f73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8315e618-4073-429e-8b9c-86f26c5cdad4', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:40 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 1073741824 Apr 30 11:20:40 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8426d93e-5da5-4114-9a22-84374b1b0fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:40 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Volume volume-8315e618-4073-429e-8b9c-86f26c5cdad4 (8315e618-4073-429e-8b9c-86f26c5cdad4): created successfully Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8426d93e-5da5-4114-9a22-84374b1b0fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:40 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (6c5e3050-e7a4-4193-b6d2-56ae6ceeb698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a75ac959-6ede-4d4f-baac-1798da5b2c01 tempest-CreateVolumesFromImageTest-569924808 None] Created volume successfully. Apr 30 11:20:41 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 1073741824" returned: 0 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:41 devstack sudo[110919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 Apr 30 11:20:41 devstack sudo[110919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:41 devstack sudo[110919]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5" returned: 0 in 0.574s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.762s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248473219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9ae661-9d84-4478-843d-b405d7cda0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336064f4251442ec8c79476691986c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:35Z,use_quota=True,user_id='733482c6cc1d45c1897812139ce4236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Creating volume ee9ae661-9d84-4478-843d-b405d7cda0bf {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:41 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4167a3-d96b-4ff5-b5c0-04f5ff6f13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef7fa61-c807-45f7-b546-0775545fc5e5', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:41 devstack sudo[110922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf 1073741824 Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbccbe-02dc-4e7b-a25e-5b294af91cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:41 devstack sudo[110922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:41 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Volume volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 (2ef7fa61-c807-45f7-b546-0775545fc5e5): created successfully Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbccbe-02dc-4e7b-a25e-5b294af91cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (9aa86f34-ba6f-4c61-b45d-175633d619dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-cd21af20-8c42-498d-9b48-6739c1918048 tempest-CreateVolumesFromImageTest-569924808 None] Created volume successfully. Apr 30 11:20:42 devstack sudo[110922]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf 1073741824" returned: 0 in 0.784s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:42 devstack sudo[110928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf Apr 30 11:20:42 devstack sudo[110928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:43 devstack sudo[110928]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf" returned: 0 in 0.546s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.040s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5615f56-be69-4bd2-95da-d93f466620ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9ae661-9d84-4478-843d-b405d7cda0bf', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4fbac3-9d95-49c8-8220-8d267da1830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Creating offline snapshot e7efb6cd-3dfa-4a5e-984a-17c3e8264226 of volume 75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:20:43 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Volume volume-ee9ae661-9d84-4478-843d-b405d7cda0bf (ee9ae661-9d84-4478-843d-b405d7cda0bf): created successfully Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4fbac3-9d95-49c8-8220-8d267da1830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Flow 'volume_create_manager' (8cf388c6-666f-46ab-a4e1-e275f5f5e630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b2cadf-b809-4b4a-857f-ca52786135a2]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:43 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-af0a6d50-9395-4e39-83c6-1d273b1b12ba tempest-CreateVolumesFromImageTest-569924808 None] Created volume successfully. Apr 30 11:20:43 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:20:43 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-ee9ae661-9d84-4478-843d-b405d7cda0bf-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-ee9ae661-9d84-4478-843d-b405d7cda0bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-quobyte-ee9ae661-9d84-4478-843d-b405d7cda0bf" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-ee9ae661-9d84-4478-843d-b405d7cda0bf" acquired by "delete_volume" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093bd57-ce81-40cc-912f-de66aa6e1875]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:43 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.705s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:43 devstack sudo[110936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf Apr 30 11:20:43 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:43 devstack sudo[110937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 1G Apr 30 11:20:43 devstack sudo[110937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:44 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf" returned: 0 in 0.708s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:44 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf Apr 30 11:20:44 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:44 devstack sudo[110937]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 1G" returned: 0 in 0.809s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:44 devstack sudo[110948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:20:44 devstack sudo[110948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:44 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-ee9ae661-9d84-4478-843d-b405d7cda0bf" returned: 0 in 0.573s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:44 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-ee9ae661-9d84-4478-843d-b405d7cda0bf" released by "delete_volume" :: held 1.321s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Created reservations ['4c6da1a4-1b40-4527-b351-9c5d9d5d90d0', '969593ea-83e2-47b7-a848-38a2b2ffc5fd', 'bf43e528-3b02-408a-808c-f88ce18fade6', 'cfbef23f-049e-43cb-822d-8a8935b939e9'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:45 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:45 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:45 devstack sudo[110948]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 0.635s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:45 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 is being set with open permissions: ugo+rw Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:45 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:20:45 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:45 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.591s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:45 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Deleted volume successfully. Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9703ad9a-3f2f-4855-9c9a-cfdae39f4fb4 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-ee9ae661-9d84-4478-843d-b405d7cda0bf-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-2ef7fa61-c807-45f7-b546-0775545fc5e5-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-2ef7fa61-c807-45f7-b546-0775545fc5e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-quobyte-2ef7fa61-c807-45f7-b546-0775545fc5e5" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:45 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 0.652s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-2ef7fa61-c807-45f7-b546-0775545fc5e5" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[25abde7a-c47b-4874-8c83-72134ea6fe31]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:45 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info Apr 30 11:20:45 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:46 devstack sudo[110961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 Apr 30 11:20:46 devstack sudo[110961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:46 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info" returned: 0 in 0.629s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:46 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info is being set with open permissions: ugo+rw Apr 30 11:20:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:46 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info Apr 30 11:20:46 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:46 devstack sudo[110961]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5" returned: 0 in 0.714s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:46 devstack sudo[110971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5 Apr 30 11:20:46 devstack sudo[110971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:47 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.info" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.061s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:47 devstack sudo[110971]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating offline snapshot 9c81e82e-3398-4218-87cc-5aaad19a0b3a of volume 1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2ef7fa61-c807-45f7-b546-0775545fc5e5" returned: 0 in 0.597s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:47 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5861a915-80fe-4452-af69-2d72dd9e08b1 tempest-VolumeDependencyTests-496657999 None] Create snapshot completed successfully Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-2ef7fa61-c807-45f7-b546-0775545fc5e5" released by "delete_volume" :: held 1.353s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a17679-dae1-4dc4-ba94-892ebcc9b815]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Created reservations ['10475a74-0566-4a9a-b2d3-620a53f93e64', '32a1bfa6-6fad-4ef5-b9cb-21fffc0dfcee', '7722e122-896a-4c44-8603-d69ab55025d1', '2675f1d3-a0fd-447e-892a-4b1cf3b573b2'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:47 devstack sudo[110975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 Apr 30 11:20:47 devstack sudo[110975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:47 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:47 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (bf8130b5-4d85-4095-b89c-6c99675aa25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5499962d-540b-4584-a457-0250a334c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5499962d-540b-4584-a457-0250a334c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-140636060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e4540a-6d86-421b-9edb-7c66861e43dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7efb6cd-3dfa-4a5e-984a-17c3e8264226,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:48Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a2701d-cc8d-42bb-a5f2-29b4c999accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a2701d-cc8d-42bb-a5f2-29b4c999accc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45eec266-6e58-4cc7-a8f7-a6da34b2a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45eec266-6e58-4cc7-a8f7-a6da34b2a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95e4540a-6d86-421b-9edb-7c66861e43dd', 'volume_name': 'volume-95e4540a-6d86-421b-9edb-7c66861e43dd', 'volume_size': 1, 'snapshot_id': 'e7efb6cd-3dfa-4a5e-984a-17c3e8264226'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:47 devstack sudo[110975]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59857641-e588-4f99-a44b-b22ec2c49f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59857641-e588-4f99-a44b-b22ec2c49f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290dc2ba-f89a-429d-b61f-0388b16482f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Volume 95e4540a-6d86-421b-9edb-7c66861e43dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95e4540a-6d86-421b-9edb-7c66861e43dd', 'volume_size': 1, 'snapshot_id': 'e7efb6cd-3dfa-4a5e-984a-17c3e8264226'} Apr 30 11:20:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871" returned: 0 in 0.760s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:48 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:48 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a 1G Apr 30 11:20:48 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Deleted volume successfully. Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-8315e618-4073-429e-8b9c-86f26c5cdad4-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-2a18effd-3561-4dd1-9dd2-ac368e700d8d tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-2ef7fa61-c807-45f7-b546-0775545fc5e5-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-8315e618-4073-429e-8b9c-86f26c5cdad4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-quobyte-8315e618-4073-429e-8b9c-86f26c5cdad4" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-8315e618-4073-429e-8b9c-86f26c5cdad4" acquired by "delete_volume" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409a948-c63c-4d94-9f6f-f56ebbcfac31]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:48 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 Apr 30 11:20:48 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:48 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a 1G" returned: 0 in 0.773s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:48 devstack sudo[110993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a Apr 30 11:20:48 devstack sudo[110993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:48 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4" returned: 0 in 0.706s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:48 devstack sudo[110996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4 Apr 30 11:20:48 devstack sudo[110996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:49 devstack sudo[110993]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a" returned: 0 in 0.680s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:49 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a is being set with open permissions: ugo+rw Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:49 devstack sudo[111002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a Apr 30 11:20:49 devstack sudo[111002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:49 devstack sudo[110996]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8315e618-4073-429e-8b9c-86f26c5cdad4" returned: 0 in 0.632s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-8315e618-4073-429e-8b9c-86f26c5cdad4" released by "delete_volume" :: held 1.383s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Created reservations ['3ab65682-0056-491f-918f-2babacec0dd7', '509b2286-b9ea-48ab-8f64-d50a92ddd517', '475d974a-560a-4f01-b47d-a10ee15c31e8', '04bd9b21-169f-4086-a286-552e7eb50204'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:49 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:49 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:50 devstack sudo[111002]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a" returned: 0 in 0.591s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:50 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info Apr 30 11:20:50 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:50 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.605s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Deleted volume successfully. Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-784ea81b-45b8-4bbd-91d3-9e7736cb31a1 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-8315e618-4073-429e-8b9c-86f26c5cdad4-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-8550517c-aa79-442e-9680-9ec8087efe7e-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-8550517c-aa79-442e-9680-9ec8087efe7e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-quobyte-8550517c-aa79-442e-9680-9ec8087efe7e" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-8550517c-aa79-442e-9680-9ec8087efe7e" acquired by "delete_volume" :: waited 0.016s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ddb600-84bf-4f1e-86e3-4512dd7eed22]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:50 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e Apr 30 11:20:50 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:50 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info" returned: 0 in 0.643s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:50 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info is being set with open permissions: ugo+rw Apr 30 11:20:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:50 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info Apr 30 11:20:50 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:51 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e" returned: 0 in 0.681s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:51 devstack sudo[111019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e Apr 30 11:20:51 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:51 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.info" returned: 0 in 0.602s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.600s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec763fe-a44a-42d8-ae33-06ca9dc34e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4878f7e1e32246ca8253f3f7e31c3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:36Z,use_quota=True,user_id='857ee648d8cf4c04983342a30fd0f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11866e32-3fb0-472a-a2a6-b2ab59f362bb),volume_type_id=11866e32-3fb0-472a-a2a6-b2ab59f362bb)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Creating volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:51 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:51 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1073741824 Apr 30 11:20:51 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:51 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4dd8e0bb-a738-4582-80c5-c8f25c110f66 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Create snapshot completed successfully Apr 30 11:20:51 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8550517c-aa79-442e-9680-9ec8087efe7e" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-8550517c-aa79-442e-9680-9ec8087efe7e" released by "delete_volume" :: held 1.320s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Created reservations ['6f0b4efb-7e12-412f-a057-d7f01c01d74e', 'fd779c80-019f-42f2-a21a-e5d82c20702a', '6bdf5997-0482-4ae3-bac6-5911cd8e939d', 'c21b97dd-1aa9-44c3-b93d-0dde81453638'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:51 devstack sudo[111025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:51 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (7d897e3a-b668-4e47-b068-eea7690a38a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f869195a-04c0-4b93-b4bf-99d243501069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f869195a-04c0-4b93-b4bf-99d243501069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16370802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad4ea7-6ec1-48a6-abfb-a5cda112a973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:52Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5358cc03-0ebf-43c4-88be-5c7c1cd84095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5358cc03-0ebf-43c4-88be-5c7c1cd84095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c532e4-5554-4040-a4d4-aa45f71d4412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c532e4-5554-4040-a4d4-aa45f71d4412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ad4ea7-6ec1-48a6-abfb-a5cda112a973', 'volume_name': 'volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc361b-82e9-46a7-9f0c-ef59370c2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc361b-82e9-46a7-9f0c-ef59370c2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6d13ba-3952-4386-93b2-f08b409765ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume c4ad4ea7-6ec1-48a6-abfb-a5cda112a973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973', 'volume_size': 1} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:52 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1073741824" returned: 0 in 0.903s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:52 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:20:52 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (ef6782f0-8cc4-4ff1-994e-0dc4e2df134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3c344a-8534-44dd-9447-9d17923a309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3c344a-8534-44dd-9447-9d17923a309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611602041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6b6e3b-533f-4d2d-873a-0724af5f2257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:52Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bbd0ec-fb20-443a-ac65-91727c29bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bbd0ec-fb20-443a-ac65-91727c29bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c3619-4d45-46b4-9931-e99e5e337728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c3619-4d45-46b4-9931-e99e5e337728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6b6e3b-533f-4d2d-873a-0724af5f2257', 'volume_name': 'volume-db6b6e3b-533f-4d2d-873a-0724af5f2257', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d710daec-2771-4613-9454-0b8cfb5e96a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d710daec-2771-4613-9454-0b8cfb5e96a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc9fb2d-eacf-49f5-aa40-6dcb81d132da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume db6b6e3b-533f-4d2d-873a-0724af5f2257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6b6e3b-533f-4d2d-873a-0724af5f2257', 'volume_size': 1} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-411d239a-892d-49b2-b181-1dd0adb724d5-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-411d239a-892d-49b2-b181-1dd0adb724d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:52 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.842s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Deleted volume successfully. Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "cinder-quobyte-411d239a-892d-49b2-b181-1dd0adb724d5" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-556c139e-e89f-429c-ac49-d66e2882c4e6 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-8550517c-aa79-442e-9680-9ec8087efe7e-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-411d239a-892d-49b2-b181-1dd0adb724d5" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e7d40-91af-48f0-b1ff-bde1095b1bea]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:52 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 Apr 30 11:20:52 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (909e3565-880a-4bc9-89e3-18e8e0c6032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facf38fa-d750-4040-ac0c-5cd621a6fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facf38fa-d750-4040-ac0c-5cd621a6fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873134911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42678b70-8434-457c-8b97-bf631160ea04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:53Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb04164-8b31-481f-9ee5-51fc660d4d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb04164-8b31-481f-9ee5-51fc660d4d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed27fd92-c2ba-436b-a23e-9c524fe776a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed27fd92-c2ba-436b-a23e-9c524fe776a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42678b70-8434-457c-8b97-bf631160ea04', 'volume_name': 'volume-42678b70-8434-457c-8b97-bf631160ea04', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e831f8b-6c7f-4b8e-8047-40f78052040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e831f8b-6c7f-4b8e-8047-40f78052040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85610cc0-20f3-4e8c-adf2-983fd44c30ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume 42678b70-8434-457c-8b97-bf631160ea04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42678b70-8434-457c-8b97-bf631160ea04', 'volume_size': 1} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:53 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 0 in 0.864s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.167s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-95e4540a-6d86-421b-9edb-7c66861e43dd" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-95e4540a-6d86-421b-9edb-7c66861e43dd" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Creating volume 95e4540a-6d86-421b-9edb-7c66861e43dd from snapshot e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Attempting download of d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}])) to volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] snapshot: e7efb6cd-3dfa-4a5e-984a-17c3e8264226, volume: 95e4540a-6d86-421b-9edb-7c66861e43dd, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51cde74-a0fc-4214-819d-2409691d7ede]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0602911-2674-4547-af29-f84e2edc8bbe]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:53 devstack sudo[111038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:20:53 devstack sudo[111038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:53 devstack sudo[111039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu Apr 30 11:20:53 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (142c48ce-ac7f-4c18-ad8b-ca5aadc5f7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d21e73-ac7b-4ce5-a0a0-29e516d544e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d21e73-ac7b-4ce5-a0a0-29e516d544e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939220202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5e539c-7973-4f11-ae93-68b5d585ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:53Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341ff2aa-7ab0-40b9-9fb9-1e1356d837ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341ff2aa-7ab0-40b9-9fb9-1e1356d837ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a57971-7ac2-413a-952e-c6bbf9d67389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a57971-7ac2-413a-952e-c6bbf9d67389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b5e539c-7973-4f11-ae93-68b5d585ebe3', 'volume_name': 'volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47073f46-33c6-4d19-93b9-7bafd7fc994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47073f46-33c6-4d19-93b9-7bafd7fc994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f749c1-3ec8-412f-b0d0-db1b2a055e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:53 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume 8b5e539c-7973-4f11-ae93-68b5d585ebe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3', 'volume_size': 1} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:53 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5" returned: 0 in 1.085s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:53 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5 Apr 30 11:20:53 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (9a0bd39a-be60-4c07-a907-3d46a9b933b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e02b0de-f418-40bd-8c3e-35a6218375dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e02b0de-f418-40bd-8c3e-35a6218375dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073410177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd8647-7a88-469e-8f37-b93cd8100d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:54Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201f9ecc-3135-4ad8-a980-5a269c7f15a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201f9ecc-3135-4ad8-a980-5a269c7f15a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3830b1-cc36-48ce-93c8-42a43f62dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3830b1-cc36-48ce-93c8-42a43f62dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dd8647-7a88-469e-8f37-b93cd8100d98', 'volume_name': 'volume-95dd8647-7a88-469e-8f37-b93cd8100d98', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91ce908-5bfa-4f0c-b13b-325c54bff0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91ce908-5bfa-4f0c-b13b-325c54bff0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b9a578-d2e2-464b-9f82-8c5d48bc1548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:20:54 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume 95dd8647-7a88-469e-8f37-b93cd8100d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dd8647-7a88-469e-8f37-b93cd8100d98', 'volume_size': 1} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:54 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu" returned: 0 in 0.898s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:54 devstack sudo[111038]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 0.937s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75304acd-9e2d-43d4-ae1e-6c48f3843579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e4c48-7b80-40af-9600-c966450ac552]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:54 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu Apr 30 11:20:54 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:54 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:20:54 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:54 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-411d239a-892d-49b2-b181-1dd0adb724d5" returned: 0 in 0.714s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-quobyte-411d239a-892d-49b2-b181-1dd0adb724d5" released by "delete_volume" :: held 1.851s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Created reservations ['ba74ed2e-7263-406a-9521-328a905ea86d', '157c1080-79d3-48ec-b406-83b282b43496', '4c55c7b2-dce6-46d9-a375-19983cb008fe', '954710f7-655c-48ed-b384-a77891e95aa0'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:20:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:54 devstack sudo[111058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:20:54 devstack sudo[111058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:54 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu" returned: 1 in 0.736s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_qdl83fqu' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a2661-fc93-4a06-aaea-a6edf0b7f188]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:55 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:55 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd Apr 30 11:20:55 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:55 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:55 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:55 devstack sudo[111058]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.702s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:20:55 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Deleted volume successfully. Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-a4557df5-f470-4aab-8620-9fcdb4142598 tempest-CreateVolumesFromImageTest-569924808 None] Lock "cinder-411d239a-892d-49b2-b181-1dd0adb724d5-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:20:55 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:55 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD Apr 30 11:20:55 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:57 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD" returned: 1 in 1.559s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:20:57 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 was raw, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:20:57 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:57 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:20:57 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:20:59 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Apr 30 11:20:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 0 in 2.048s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:20:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6_dws5cq5zdevstack@QuobyteHD, size 0.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:20:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Converted 0.00 MB image at 0.00 MB/s Apr 30 11:20:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:20:59 devstack sudo[111101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1G Apr 30 11:20:59 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:00 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 1G" returned: 0 in 1.538s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dbc8d9-6c71-421e-8af1-143d8e0201dc]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:01 devstack sudo[111108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:21:01 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:01 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd" returned: 0 in 6.091s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fdb00d-9799-44bc-8c54-371812e2dffd]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:01 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:21:01 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:01 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 0 in 0.776s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:01 devstack sudo[111114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:21:01 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:02 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.975s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Converted 1024.00 MB image at 168.08 MB/s Apr 30 11:21:02 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd is being set with open permissions: ugo+rw Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:02 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd Apr 30 11:21:02 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:02 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 1 in 0.788s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Downloaded image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}])) to volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33 successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Temporary image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 for user 857ee648d8cf4c04983342a30fd0f844 is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Marking volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33 as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Copying metadata from image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 to 1ec763fe-a44a-42d8-ae33-06ca9dc34e33. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Creating volume glance metadata for volume 1ec763fe-a44a-42d8-ae33-06ca9dc34e33 backed by image d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a13192fc3757aafd8751eeec10ba7792', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83031b74-efec-4129-90b8-27ce6af385f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33', 'volume_size': 1, 'image_id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a13192fc3757aafd8751eeec10ba7792', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4878f7e1e32246ca8253f3f7e31c3068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f5486d54f86e71046a31bb1fe03d1a3c34d5243ed3af198b835e73830a4820321e053f4f01ec1ecb065879f7ce8660832b5e09aad631d1057478c9eb58f34', 'id': 'd3ad99ed-c5e1-4c08-ac1a-2a30279e66e6', 'created_at': datetime.datetime(2026, 4, 30, 9, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3ad99ed-c5e1-4c08-ac1a-2a30279e66e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68338b74-9e2d-4b66-a88d-c3e16c973017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Volume volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 (1ec763fe-a44a-42d8-ae33-06ca9dc34e33): created successfully Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68338b74-9e2d-4b66-a88d-c3e16c973017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Flow 'volume_create_manager' (bfe2fd1b-b4a3-4f82-9e5a-8dd50c141b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-10313431-9192-43bd-9f57-60a253933626 tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Created volume successfully. Apr 30 11:21:02 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd" returned: 0 in 0.660s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" released by "_copy_volume_from_snapshot" :: held 9.571s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-95e4540a-6d86-421b-9edb-7c66861e43dd" released by "_create_volume_from_snapshot" :: held 9.621s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.653s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.691s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16370802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad4ea7-6ec1-48a6-abfb-a5cda112a973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:52Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:02 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 1073741824 Apr 30 11:21:02 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290dc2ba-f89a-429d-b61f-0388b16482f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e4540a-6d86-421b-9edb-7c66861e43dd', 'volume_size': 1, 'snapshot_id': 'e7efb6cd-3dfa-4a5e-984a-17c3e8264226'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79a972-4795-4fb6-8bfe-cb9dc0940f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Volume volume-95e4540a-6d86-421b-9edb-7c66861e43dd (95e4540a-6d86-421b-9edb-7c66861e43dd): created successfully Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79a972-4795-4fb6-8bfe-cb9dc0940f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:02 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (bf8130b5-4d85-4095-b89c-6c99675aa25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:02 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-15a1a378-892b-4a31-a28c-4b3663265221 tempest-VolumeDependencyTests-496657999 None] Created volume successfully. Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Deleting offline snapshot e7efb6cd-3dfa-4a5e-984a-17c3e8264226 of volume 75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] snapshot_file for this snap is: volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5645dfe-70be-42d6-83d3-5bc73af4ee21]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:03 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:21:03 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:03 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 1073741824" returned: 0 in 0.946s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Acquiring lock "cinder-1ec763fe-a44a-42d8-ae33-06ca9dc34e33-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "cinder-1ec763fe-a44a-42d8-ae33-06ca9dc34e33-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:03 devstack sudo[111134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 Apr 30 11:21:03 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:03 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Acquiring lock "cinder-quobyte-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "cinder-quobyte-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97d193-4930-4e8c-b2c3-3098a4aab105]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:04 devstack sudo[111136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:21:04 devstack sudo[111136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:04 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 0.989s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75304acd-9e2d-43d4-ae1e-6c48f3843579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ffa8c3-7d75-4306-9a87-51e1656423f5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:04 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" returned: 0 in 0.691s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.992s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611602041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6b6e3b-533f-4d2d-873a-0724af5f2257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:52Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:04 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume db6b6e3b-533f-4d2d-873a-0724af5f2257 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:04 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:04 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6d13ba-3952-4386-93b2-f08b409765ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6741ea08-c4da-4220-ad2e-c40244f48071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:04 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 1073741824 Apr 30 11:21:04 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 (c4ad4ea7-6ec1-48a6-abfb-a5cda112a973): created successfully Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6741ea08-c4da-4220-ad2e-c40244f48071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (7d897e3a-b668-4e47-b068-eea7690a38a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:04 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4a0fbebb-0c28-4bcc-95b2-99382281ee52 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:21:04 devstack sudo[111136]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 0 in 0.826s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:05 devstack sudo[111182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:21:05 devstack sudo[111182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:05 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.957s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:05 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:21:05 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:05 devstack sudo[111182]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 1 in 1.015s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:05 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 1073741824" returned: 0 in 1.334s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:05 devstack sudo[111198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33 Apr 30 11:21:05 devstack sudo[111198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:06 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 Apr 30 11:21:06 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:06 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:06 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:06 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 0.949s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:06 devstack sudo[111207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226 Apr 30 11:21:06 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:06 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257" returned: 0 in 0.950s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.803s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873134911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42678b70-8434-457c-8b97-bf631160ea04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:53Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume 42678b70-8434-457c-8b97-bf631160ea04 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:06 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:07 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 1073741824 Apr 30 11:21:07 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc9fb2d-eacf-49f5-aa40-6dcb81d132da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6b6e3b-533f-4d2d-873a-0724af5f2257', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6595ca3-41ef-4e05-835d-ecba532ec8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:07 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 (db6b6e3b-533f-4d2d-873a-0724af5f2257): created successfully Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6595ca3-41ef-4e05-835d-ecba532ec8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (ef6782f0-8cc4-4ff1-994e-0dc4e2df134d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4cd62a2b-bba8-452c-8a32-f5365d2f32df tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:21:07 devstack sudo[111198]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" returned: 0 in 1.296s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:07 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.132s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "cinder-quobyte-1ec763fe-a44a-42d8-ae33-06ca9dc34e33" released by "delete_volume" :: held 3.253s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Created reservations ['6841ed47-bff1-4fea-ae1f-41a2d7430f52', '55c311ea-06e8-46eb-80d6-3106237ee4d7', 'bf2c3a82-da6c-4802-b72a-2cb7aba9ff96', 'd19428bd-abcd-4b94-8f56-5feb7a9479c6'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:07 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579.e7efb6cd-3dfa-4a5e-984a-17c3e8264226" returned: 0 in 1.175s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:07 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:07 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-e7efb6cd-3dfa-4a5e-984a-17c3e8264226" released by "_delete_snapshot" :: held 4.249s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" released by "delete_snapshot" :: held 4.282s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Created reservations ['f1965881-d079-4315-a6c7-14b8b0dc4385', '9e808b0b-9469-472e-a31c-f9ea1b560469', 'ef76d1c6-4daa-4d6e-ad61-2100f5d93060', '6e2f949b-b27f-4538-a054-ed1cda9cc380'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:07 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Delete snapshot completed successfully. Apr 30 11:21:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6c8fddb6-41ac-4dd7-b907-a2d25ed84aad tempest-VolumeDependencyTests-496657999 None] Lock "cinder-e7efb6cd-3dfa-4a5e-984a-17c3e8264226-delete_snapshot" released by "delete_snapshot" :: held 4.537s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:08 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 1073741824" returned: 0 in 1.149s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:08 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 Apr 30 11:21:08 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:08 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.768s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Deleted volume successfully. Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6febdab7-332d-4228-b1d2-224030aff62d tempest-VolumeAndVolumeTypeFromImageTest-887199368 None] Lock "cinder-1ec763fe-a44a-42d8-ae33-06ca9dc34e33-delete_volume" released by "delete_volume" :: held 4.421s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-75304acd-9e2d-43d4-ae1e-6c48f3843579-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-75304acd-9e2d-43d4-ae1e-6c48f3843579-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd30c5-05a0-44fc-b897-0c8f3dd3e9da]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:09 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:09 devstack sudo[111224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:21:09 devstack sudo[111224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04" returned: 0 in 0.975s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.474s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939220202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5e539c-7973-4f11-ae93-68b5d585ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:53Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume 8b5e539c-7973-4f11-ae93-68b5d585ebe3 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:09 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:09 devstack sudo[111227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 1073741824 Apr 30 11:21:09 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85610cc0-20f3-4e8c-adf2-983fd44c30ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42678b70-8434-457c-8b97-bf631160ea04', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb3dea6-2a40-45ff-a110-b4d7116d3ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:09 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-42678b70-8434-457c-8b97-bf631160ea04 (42678b70-8434-457c-8b97-bf631160ea04): created successfully Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb3dea6-2a40-45ff-a110-b4d7116d3ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:09 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (909e3565-880a-4bc9-89e3-18e8e0c6032d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-92634629-2fec-4829-9b4a-76f64f6c7140 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:21:10 devstack sudo[111224]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 1.192s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:10 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579 Apr 30 11:21:10 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:10 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 1073741824" returned: 0 in 1.295s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:10 devstack sudo[111239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 Apr 30 11:21:10 devstack sudo[111239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:10 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-75304acd-9e2d-43d4-ae1e-6c48f3843579" returned: 0 in 0.786s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-75304acd-9e2d-43d4-ae1e-6c48f3843579" released by "delete_volume" :: held 2.068s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Created reservations ['7f169aae-25b3-4c45-9ec2-3df1ed549d5e', '4d424106-5c45-4261-afe6-5ec59aff6ff8', 'f3104b6e-df71-4da3-ab2f-fe1727074756', '6fca53f3-dfcb-41e1-a88c-e27ccfcf9299'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:11 devstack sudo[111243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:11 devstack sudo[111243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:11 devstack sudo[111239]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.165s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073410177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd8647-7a88-469e-8f37-b93cd8100d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534dcdd163e44b90ab9a6aeba5f15963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:20:54Z,use_quota=True,user_id='902be7055af440e9b44b8adfd505d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Creating volume 95dd8647-7a88-469e-8f37-b93cd8100d98 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:11 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f749c1-3ec8-412f-b0d0-db1b2a055e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:11 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 1073741824 Apr 30 11:21:11 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f3ebf3-7ee1-4bff-98bd-2cff8e2b9ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:11 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 (8b5e539c-7973-4f11-ae93-68b5d585ebe3): created successfully Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f3ebf3-7ee1-4bff-98bd-2cff8e2b9ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:11 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (142c48ce-ac7f-4c18-ad8b-ca5aadc5f7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3e25793b-c503-43d3-9759-4ed5cd886f02 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:21:12 devstack sudo[111243]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.819s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Deleted volume successfully. Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-62d65338-25f4-4c70-8399-14136aedfe82 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-75304acd-9e2d-43d4-ae1e-6c48f3843579-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:12 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 1073741824" returned: 0 in 1.111s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:12 devstack sudo[111252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 Apr 30 11:21:12 devstack sudo[111252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (dd062cd8-5b4d-40a9-8a59-3efaa08f15b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491535df-c8dc-471c-b4a6-95552995d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491535df-c8dc-471c-b4a6-95552995d905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-90353536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7a1363-c290-4571-b287-18c38165c297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:13Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63df99e-7446-4365-ba24-1cab584d2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63df99e-7446-4365-ba24-1cab584d2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfc7b85-db40-47e2-833b-ca5384918f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfc7b85-db40-47e2-833b-ca5384918f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7a1363-c290-4571-b287-18c38165c297', 'volume_name': 'volume-9b7a1363-c290-4571-b287-18c38165c297', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8041454c-feca-4ca5-bab9-e41c0be26e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8041454c-feca-4ca5-bab9-e41c0be26e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aea3bf0-815d-47eb-ad99-1ed7639875ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:12 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Volume 9b7a1363-c290-4571-b287-18c38165c297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7a1363-c290-4571-b287-18c38165c297', 'volume_size': 1} Apr 30 11:21:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:13 devstack sudo[111252]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98" returned: 0 in 0.771s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-90353536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7a1363-c290-4571-b287-18c38165c297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:13Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Creating volume 9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:13 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:13 devstack sudo[111255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 1073741824 Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b9a578-d2e2-464b-9f82-8c5d48bc1548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dd8647-7a88-469e-8f37-b93cd8100d98', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:13 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bbabe-6b9f-4341-a547-b9c368ea461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:13 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Volume volume-95dd8647-7a88-469e-8f37-b93cd8100d98 (95dd8647-7a88-469e-8f37-b93cd8100d98): created successfully Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957bbabe-6b9f-4341-a547-b9c368ea461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:13 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Flow 'volume_create_manager' (9a0bd39a-be60-4c07-a907-3d46a9b933b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:13 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0dae958e-aaf1-46fd-9a71-3d2b33769d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created volume successfully. Apr 30 11:21:14 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 1073741824" returned: 0 in 0.859s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:14 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:14 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-95dd8647-7a88-469e-8f37-b93cd8100d98-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-95dd8647-7a88-469e-8f37-b93cd8100d98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-95dd8647-7a88-469e-8f37-b93cd8100d98" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-95dd8647-7a88-469e-8f37-b93cd8100d98" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c3d7c4-e39d-49d0-8670-08714dba39e4]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:14 devstack sudo[111264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 Apr 30 11:21:14 devstack sudo[111264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:14 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.760s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aea3bf0-815d-47eb-ad99-1ed7639875ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7a1363-c290-4571-b287-18c38165c297', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d815df-9630-4478-8c12-798d61866533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:14 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Volume volume-9b7a1363-c290-4571-b287-18c38165c297 (9b7a1363-c290-4571-b287-18c38165c297): created successfully Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d815df-9630-4478-8c12-798d61866533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:14 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (dd062cd8-5b4d-40a9-8a59-3efaa08f15b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0b6a5c00-35a0-4b9a-92db-86a855a38b84 tempest-VolumeDependencyTests-496657999 None] Created volume successfully. Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (85df2042-2ddf-4dfd-8ee1-f6f55479e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaf631e-2363-46fa-a492-da535cc386ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaf631e-2363-46fa-a492-da535cc386ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765966734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2ef4fb-791c-4a78-b238-b10bd0373a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:15Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1dc35-da2b-41b7-b5d7-e27b12d5bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1dc35-da2b-41b7-b5d7-e27b12d5bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63982a81-0053-4658-8240-b63f36cedc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63982a81-0053-4658-8240-b63f36cedc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2ef4fb-791c-4a78-b238-b10bd0373a22', 'volume_name': 'volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3efa198-f9ea-4873-9593-60e7aa16cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3efa198-f9ea-4873-9593-60e7aa16cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78efc6b-0e80-40ad-91af-4f5f9a22c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:15 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume dd2ef4fb-791c-4a78-b238-b10bd0373a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22', 'volume_size': 1} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765966734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2ef4fb-791c-4a78-b238-b10bd0373a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:15Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume dd2ef4fb-791c-4a78-b238-b10bd0373a22 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:15 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:15 devstack sudo[111267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 1073741824 Apr 30 11:21:15 devstack sudo[111267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:15 devstack sudo[111264]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98" returned: 0 in 0.885s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:15 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98 Apr 30 11:21:15 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:16 devstack sudo[111267]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 1073741824" returned: 0 in 0.869s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:16 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 Apr 30 11:21:16 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:16 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95dd8647-7a88-469e-8f37-b93cd8100d98" returned: 0 in 0.651s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-95dd8647-7a88-469e-8f37-b93cd8100d98" released by "delete_volume" :: held 1.591s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['42210f1c-9960-4d10-8b94-309e83a70477', '74dcaa21-9ec0-4034-b6e5-d986e852d4de', '1606d8a7-b40c-40a7-abce-b74194e8b8d0', '41e63d37-8089-45c3-842f-5e4434edeb0b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:16 devstack sudo[111283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:16 devstack sudo[111283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-8b5e539c-7973-4f11-ae93-68b5d585ebe3-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-8b5e539c-7973-4f11-ae93-68b5d585ebe3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-8b5e539c-7973-4f11-ae93-68b5d585ebe3" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (60646f3d-f04c-47cb-9a28-d119337bbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2578bc2d-0146-491b-9048-0efb1b8fa214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2578bc2d-0146-491b-9048-0efb1b8fa214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146784505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5ac785-1c93-4cdb-9220-c532512a42f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc64617f305e43e4b5b3c3b3f175a8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9b7a1363-c290-4571-b287-18c38165c297,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:17Z,use_quota=True,user_id='71b0d9ddc86846deb586db45996f8606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c68424-101b-4201-aaf4-e1bbdedaab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c68424-101b-4201-aaf4-e1bbdedaab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a76cb-fbc5-4faa-97a7-5ace09a57853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-8b5e539c-7973-4f11-ae93-68b5d585ebe3" acquired by "delete_volume" :: waited 0.061s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a2692-f27b-4671-b938-e0daabf66f25]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a76cb-fbc5-4faa-97a7-5ace09a57853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6a5ac785-1c93-4cdb-9220-c532512a42f6', 'volume_name': 'volume-6a5ac785-1c93-4cdb-9220-c532512a42f6', 'volume_size': 1, 'source_volid': '9b7a1363-c290-4571-b287-18c38165c297', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9f962b-be4c-44c3-abd6-c0c5a41c384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9f962b-be4c-44c3-abd6-c0c5a41c384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaa13f1-2a9b-479a-94f5-4416ea5e5beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:16 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Volume 6a5ac785-1c93-4cdb-9220-c532512a42f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6a5ac785-1c93-4cdb-9220-c532512a42f6', 'volume_size': 1, 'source_volid': '9b7a1363-c290-4571-b287-18c38165c297', 'source_volstatus': 'available'} Apr 30 11:21:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:17 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22" returned: 0 in 1.049s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.100s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:17 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Cloning volume 9b7a1363-c290-4571-b287-18c38165c297 to volume 6a5ac785-1c93-4cdb-9220-c532512a42f6 Apr 30 11:21:17 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 Apr 30 11:21:17 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78efc6b-0e80-40ad-91af-4f5f9a22c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2d367e-32eb-40ed-9f71-db7ed5bbd1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:17 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 (dd2ef4fb-791c-4a78-b238-b10bd0373a22): created successfully Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2d367e-32eb-40ed-9f71-db7ed5bbd1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (85df2042-2ddf-4dfd-8ee1-f6f55479e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Creating offline snapshot 985715ed-49f0-4318-a3e3-77dd22ea923d of volume 9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:21:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-aa5b766b-6052-48c9-bfdf-568089884e4a tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b1bc6f-cc63-4834-9d6f-474b77f7262c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:17 devstack sudo[111283]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.978s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:17 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-d4f4bafb-7cac-4624-a10c-eb8b1b7e9f05 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-95dd8647-7a88-469e-8f37-b93cd8100d98-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:17 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:17 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:17 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3" returned: 0 in 0.967s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:17 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3 Apr 30 11:21:17 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:18 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.958s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:18 devstack sudo[111299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d 1G Apr 30 11:21:18 devstack sudo[111299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:18 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:18 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (72add1cf-8c0e-4672-87a6-b09d8a3a8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d7f273-bd75-47e2-a06d-b5c6967619ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8b5e539c-7973-4f11-ae93-68b5d585ebe3" returned: 0 in 1.086s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d7f273-bd75-47e2-a06d-b5c6967619ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034470937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309d30c4-7bf9-462e-89cf-118515edafef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:19Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0608b0f7-07c1-40bd-b1f5-32a1ab5f5455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0608b0f7-07c1-40bd-b1f5-32a1ab5f5455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759db409-5701-4a8f-bf61-ba406342fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759db409-5701-4a8f-bf61-ba406342fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309d30c4-7bf9-462e-89cf-118515edafef', 'volume_name': 'volume-309d30c4-7bf9-462e-89cf-118515edafef', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bf89df-f98a-4d44-93fe-ba1184aed5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bf89df-f98a-4d44-93fe-ba1184aed5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309ca21f-8b29-425e-bc0e-ede3cec2afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume 309d30c4-7bf9-462e-89cf-118515edafef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309d30c4-7bf9-462e-89cf-118515edafef', 'volume_size': 1} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-8b5e539c-7973-4f11-ae93-68b5d585ebe3" released by "delete_volume" :: held 2.234s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['a41c0370-0b73-4e3a-9352-2c1de66b4eba', 'ef26587b-7584-4f24-81de-8c3c25708940', '86c7ec2e-d0d6-494a-b128-a239fdbb933b', 'ad9ce8e3-55cd-4904-8185-efd319cb258f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:19 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:19 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:19 devstack sudo[111299]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d 1G" returned: 0 in 1.285s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a1363-c290-4571-b287-18c38165c297 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:19 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a1363-c290-4571-b287-18c38165c297 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:19 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (7e2c652a-8a69-47f2-93a5-7b5686e6fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa324415-d7be-46f8-9cda-4922bdfa5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa324415-d7be-46f8-9cda-4922bdfa5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35067861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:20Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49027034-5860-4eb7-9b90-9a159292530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49027034-5860-4eb7-9b90-9a159292530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33240b06-3aac-4c76-a233-699f4955e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33240b06-3aac-4c76-a233-699f4955e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88', 'volume_name': 'volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6182b75-4ac1-47a3-8fe4-7ab1a55e6cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6182b75-4ac1-47a3-8fe4-7ab1a55e6cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b3a88-c906-4b5a-a093-8bc01d71facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:19 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88', 'volume_size': 1} Apr 30 11:21:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:20 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.751s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:20 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-edf89a3f-0123-43c6-830a-221124ad0d1f tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-8b5e539c-7973-4f11-ae93-68b5d585ebe3-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (5265d99a-31c2-4d08-8173-0a5e3ecb9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020af76b-ce07-4a8b-875b-68576661ffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-42678b70-8434-457c-8b97-bf631160ea04-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020af76b-ce07-4a8b-875b-68576661ffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236795932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:20Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b717f3da-1192-4781-b6b5-7ec8cb8c086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b717f3da-1192-4781-b6b5-7ec8cb8c086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4fff7-3bd1-4da7-9e16-17281d3cc032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4fff7-3bd1-4da7-9e16-17281d3cc032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c', 'volume_name': 'volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd09e75-2487-4201-aa9d-15aadf03584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd09e75-2487-4201-aa9d-15aadf03584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aa77e7-5ca2-40c9-906a-75794eaf915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume 1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c', 'volume_size': 1} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-42678b70-8434-457c-8b97-bf631160ea04-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-42678b70-8434-457c-8b97-bf631160ea04" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-42678b70-8434-457c-8b97-bf631160ea04" acquired by "delete_volume" :: waited 0.039s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed4b94-ee0c-420b-86c9-94750f1fe8c0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:20 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a1363-c290-4571-b287-18c38165c297 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 1.243s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:20 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d is being set with open permissions: ugo+rw Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:20 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:20 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:20 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 Apr 30 11:21:20 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (e1468026-c47d-4543-8e8b-0fadcd80cb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ca4d7e-aa14-48d4-aeb6-856e70a52a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ca4d7e-aa14-48d4-aeb6-856e70a52a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607102199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcf8cb7-7c63-4138-851a-e1e5a83b2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:21Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9492ebe8-6651-4b1e-b486-f390282341f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9492ebe8-6651-4b1e-b486-f390282341f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c99d3e2-7866-40a4-84a7-90fdd4bb1db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c99d3e2-7866-40a4-84a7-90fdd4bb1db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfcf8cb7-7c63-4138-851a-e1e5a83b2614', 'volume_name': 'volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7ac4a1-7418-4437-9916-0c5991ea20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7ac4a1-7418-4437-9916-0c5991ea20eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6b33c3-7c4e-47b4-b7a4-f842025af1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:20 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume bfcf8cb7-7c63-4138-851a-e1e5a83b2614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614', 'volume_size': 1} Apr 30 11:21:20 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (d10eeedc-9642-40ba-88b9-f9e7f86fac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:21 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60914d8-5b03-46f3-a516-dbc5b3e357d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04" returned: 0 in 0.958s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60914d8-5b03-46f3-a516-dbc5b3e357d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121889653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744afdb-756d-4eb0-8f04-092be5a79618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:21Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de771c-f788-416c-afcc-903a7bd36f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de771c-f788-416c-afcc-903a7bd36f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:21 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04 Apr 30 11:21:21 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4fcdae-383a-4231-9c5b-908dbe74178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4fcdae-383a-4231-9c5b-908dbe74178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2744afdb-756d-4eb0-8f04-092be5a79618', 'volume_name': 'volume-2744afdb-756d-4eb0-8f04-092be5a79618', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f744205-e04b-4fd2-8c23-5c843a5aa06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f744205-e04b-4fd2-8c23-5c843a5aa06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983a29e1-9dd5-428b-a8ed-2a2e260ea43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:21 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume 2744afdb-756d-4eb0-8f04-092be5a79618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2744afdb-756d-4eb0-8f04-092be5a79618', 'volume_size': 1} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:21 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 1.009s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:21 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:21 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info Apr 30 11:21:21 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:22 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-42678b70-8434-457c-8b97-bf631160ea04" returned: 0 in 0.846s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-42678b70-8434-457c-8b97-bf631160ea04" released by "delete_volume" :: held 1.893s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:22 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info" returned: 0 in 0.687s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:22 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info is being set with open permissions: ugo+rw Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:22 devstack sudo[111330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info Apr 30 11:21:22 devstack sudo[111330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['eae2bd86-a33c-47a3-8f4d-a4ad91079f86', 'b780965f-8909-472f-a926-16aaad49cc9e', '76b5612d-8a4a-4d5e-81ad-2d4c3b01008d', '0e95f1b4-e636-475f-838a-499ee7084f3e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:22 devstack sudo[111332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:22 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-db6b6e3b-533f-4d2d-873a-0724af5f2257-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-db6b6e3b-533f-4d2d-873a-0724af5f2257-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-db6b6e3b-533f-4d2d-873a-0724af5f2257" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-db6b6e3b-533f-4d2d-873a-0724af5f2257" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e33f5-b318-433b-9fcf-c7e166c25bac]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:22 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:22 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 Apr 30 11:21:22 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Flow 'volume_create_manager' (1cbca6a5-0847-4f07-b39a-bd5f4b0ebed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c59c06-d1a4-4be5-8975-43f6502eb890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c59c06-d1a4-4be5-8975-43f6502eb890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2044210228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbbc541-2dbf-4e98-ba28-933dfde54f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9535a45f53e3461a83fb088fb1212dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:23Z,use_quota=True,user_id='b61d87c51f984fecbbb1fe1e33299ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc72c5-483f-4c14-ae5a-946f198bd5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc72c5-483f-4c14-ae5a-946f198bd5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45968ec2-3622-4594-8a1c-789f3ba978de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45968ec2-3622-4594-8a1c-789f3ba978de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fbbc541-2dbf-4e98-ba28-933dfde54f64', 'volume_name': 'volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7490bf9-4238-4534-a3a3-5fb64a726e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7490bf9-4238-4534-a3a3-5fb64a726e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087377c2-8294-4d5e-b888-c109971027e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:23 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Volume 8fbbc541-2dbf-4e98-ba28-933dfde54f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64', 'volume_size': 1} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:23 devstack sudo[111330]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.info" returned: 0 in 0.740s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] snapshot: 985715ed-49f0-4318-a3e3-77dd22ea923d, volume: 6a5ac785-1c93-4cdb-9220-c532512a42f6, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0750a23-74a9-45a1-851e-8dd33f77f6b5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:23 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.755s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:23 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-0ad3fc1a-ea52-44b9-9491-f1de83625bf8 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-42678b70-8434-457c-8b97-bf631160ea04-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:23 devstack sudo[111338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:23 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:23 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257" returned: 0 in 0.716s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:23 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:23 devstack sudo[111343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257 Apr 30 11:21:23 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:24 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 0.712s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7a1363-c290-4571-b287-18c38165c297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d82a2a-69d3-4cf0-93d2-423501a22a66]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:24 devstack sudo[111348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:24 devstack sudo[111348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:24 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-db6b6e3b-533f-4d2d-873a-0724af5f2257" returned: 0 in 0.584s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-db6b6e3b-533f-4d2d-873a-0724af5f2257" released by "delete_volume" :: held 1.369s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['f94f188f-1182-4c70-90cb-e859a5d53d60', '276ba2e4-62e8-4fb8-8440-ce8032a86c85', 'cb444231-7326-4691-b34f-dfaa3a295efb', '210ab0e4-fbd8-46a9-bf7c-ac8477ab4533'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:24 devstack sudo[111351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:24 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:24 devstack sudo[111348]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.742s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:24 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 Apr 30 11:21:24 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:24 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.585s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:24 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-fbe08beb-9792-4f72-8b1d-54cd1bee1369 tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-db6b6e3b-533f-4d2d-873a-0724af5f2257-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:24 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:25 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:25 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeca52d-6016-4b5b-88f2-273e634d3b91]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:25 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:25 devstack sudo[111359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 Apr 30 11:21:25 devstack sudo[111359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:26 devstack sudo[111359]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" returned: 0 in 0.979s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:26 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:26 devstack sudo[111374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973 Apr 30 11:21:26 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:27 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" returned: 0 in 1.188s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973" released by "delete_volume" :: held 2.249s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['ee180e61-7e65-4743-9ea3-7edc8be2b50e', '109b27a0-2ff5-4cfe-8886-923b39b21975', '6bcc03ba-7024-41a4-ac41-8ef935728589', 'd2350e01-fec5-477e-b702-f82f36711dd0'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:27 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:27 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:27 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-9c81e82e-3398-4218-87cc-5aaad19a0b3a-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-9c81e82e-3398-4218-87cc-5aaad19a0b3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-9c81e82e-3398-4218-87cc-5aaad19a0b3a" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-9c81e82e-3398-4218-87cc-5aaad19a0b3a" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleting offline snapshot 9c81e82e-3398-4218-87cc-5aaad19a0b3a of volume 1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] snapshot_file for this snap is: volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d393776-eb4d-4d93-8962-4dab88b396f0]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:28 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:28 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.460s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:29 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:29 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:29 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-82cc5087-2b95-4ae7-ab82-4904b31ead2d tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-c4ad4ea7-6ec1-48a6-abfb-a5cda112a973-delete_volume" released by "delete_volume" :: held 4.179s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:29 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a Apr 30 11:21:29 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:30 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6" returned: 0 in 5.290s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab8c73e-6377-4fd4-ad0d-698d378b7f1a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:30 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a" returned: 0 in 1.412s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ac45017-e1cd-43d0-93a2-cf66516cf871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:21:30 devstack sudo[111387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:30 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8d6a8-f820-4eb9-a283-10f71a24b7fa]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:30 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 Apr 30 11:21:30 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:30 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871" returned: 0 in 0.735s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:30 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:31 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.912s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:21:31 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Converted 1024.00 MB image at 193.53 MB/s Apr 30 11:21:31 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 is being set with open permissions: ugo+rw Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:31 devstack sudo[111399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a Apr 30 11:21:31 devstack sudo[111399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:31 devstack sudo[111401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 Apr 30 11:21:31 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:31 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6" returned: 0 in 0.608s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" released by "_copy_volume_from_snapshot" :: held 8.364s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:UPDATE=166,cinder:SELECT=122,cinder:INSERT=45,cinder:DELETE=12 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:21:31 devstack sudo[111399]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-985715ed-49f0-4318-a3e3-77dd22ea923d" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:31 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a Apr 30 11:21:31 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-985715ed-49f0-4318-a3e3-77dd22ea923d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Deleting offline snapshot 985715ed-49f0-4318-a3e3-77dd22ea923d of volume 9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] snapshot_file for this snap is: volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2713f-39fd-4200-b9f9-f49133af14f9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:31 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:31 devstack sudo[111409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:31 devstack sudo[111409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:32 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871.9c81e82e-3398-4218-87cc-5aaad19a0b3a" returned: 0 in 0.594s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=122,cinder:UPDATE=150,cinder:DELETE=18,cinder:INSERT=36 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-9c81e82e-3398-4218-87cc-5aaad19a0b3a" released by "_delete_snapshot" :: held 3.572s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" released by "delete_snapshot" :: held 3.657s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['f8c9cb86-56ec-446f-89f0-fae4b13fdd3d', 'c5d99d9f-b0be-4000-8851-1b712321ec84', 'f31f8df3-c6aa-4d95-9caf-b2b18600b665', '537806c7-9d73-4e49-9acc-95be72456e41'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:32 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Delete snapshot completed successfully. Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-1f73ae42-5027-4d99-b698-0d801d7c4d1a tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-9c81e82e-3398-4218-87cc-5aaad19a0b3a-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:32 devstack sudo[111409]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7a1363-c290-4571-b287-18c38165c297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[36166ef1-ea1c-41c1-a632-85b77b1bc69b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:32 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:32 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-1ac45017-e1cd-43d0-93a2-cf66516cf871-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-1ac45017-e1cd-43d0-93a2-cf66516cf871-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:32 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca88934-741d-4638-8370-990dd351f287]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:33 devstack sudo[111418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 Apr 30 11:21:33 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:33 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.758s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:33 devstack sudo[111423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:33 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:33 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871" returned: 0 in 0.725s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:33 devstack sudo[111429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871 Apr 30 11:21:33 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:33 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 0.707s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:33 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:34 devstack sudo[111433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d Apr 30 11:21:34 devstack sudo[111433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:34 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1ac45017-e1cd-43d0-93a2-cf66516cf871" returned: 0 in 0.626s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-quobyte-1ac45017-e1cd-43d0-93a2-cf66516cf871" released by "delete_volume" :: held 1.424s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Created reservations ['ad3b5301-de06-4d09-bf9a-78d330b3df96', '77eb0181-2666-4560-a01a-f10fdbeba912', '4f5c343d-4105-4df0-9fd0-69f8c2026b75', '34321826-dff7-4f3d-a347-febf1718f4f5'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:34 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:34 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:34 devstack sudo[111433]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297.985715ed-49f0-4318-a3e3-77dd22ea923d" returned: 0 in 0.699s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-985715ed-49f0-4318-a3e3-77dd22ea923d" released by "_delete_snapshot" :: held 3.007s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.606s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.572s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034470937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309d30c4-7bf9-462e-89cf-118515edafef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:19Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume 309d30c4-7bf9-462e-89cf-118515edafef {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:34 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaa13f1-2a9b-479a-94f5-4416ea5e5beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5ac785-1c93-4cdb-9220-c532512a42f6', 'volume_size': 1, 'source_volid': '9b7a1363-c290-4571-b287-18c38165c297', 'source_volstatus': 'available'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c616c653-b1fb-4da5-8a3b-a36d9b91c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:34 devstack sudo[111439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef 1073741824 Apr 30 11:21:34 devstack sudo[111439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:34 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Volume volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 (6a5ac785-1c93-4cdb-9220-c532512a42f6): created successfully Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c616c653-b1fb-4da5-8a3b-a36d9b91c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:34 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Flow 'volume_create_manager' (60646f3d-f04c-47cb-9a28-d119337bbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:34 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-717fe4a4-d7cb-4767-8b68-35fae745a771 tempest-VolumeDependencyTests-496657999 None] Created volume successfully. Apr 30 11:21:35 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.679s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:35 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Deleted volume successfully. Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-9fabc473-6253-4f72-a175-eab86c5b1adc tempest-CreateVolumesFromSnapshotTest-1495275593 None] Lock "cinder-1ac45017-e1cd-43d0-93a2-cf66516cf871-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-9b7a1363-c290-4571-b287-18c38165c297-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-9b7a1363-c290-4571-b287-18c38165c297-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-9b7a1363-c290-4571-b287-18c38165c297" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-9b7a1363-c290-4571-b287-18c38165c297" acquired by "delete_volume" :: waited 0.028s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caca432-dc88-4126-83fc-f89d1bd2da3b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:35 devstack sudo[111439]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef 1073741824" returned: 0 in 0.969s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:35 devstack sudo[111446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:35 devstack sudo[111446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:35 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:35 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef Apr 30 11:21:35 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:36 devstack sudo[111446]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.760s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:36 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef" returned: 0 in 0.654s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.527s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35067861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:20Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:36 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297 Apr 30 11:21:36 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:36 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309ca21f-8b29-425e-bc0e-ede3cec2afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309d30c4-7bf9-462e-89cf-118515edafef', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:36 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 1073741824 Apr 30 11:21:36 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8f1a7e-13eb-4c6c-a36d-32f0f44ec032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:36 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-309d30c4-7bf9-462e-89cf-118515edafef (309d30c4-7bf9-462e-89cf-118515edafef): created successfully Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8f1a7e-13eb-4c6c-a36d-32f0f44ec032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:36 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (72add1cf-8c0e-4672-87a6-b09d8a3a8043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:36 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e3976eb1-1dbf-41a0-9dab-10fa2c536dff tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:37 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-9b7a1363-c290-4571-b287-18c38165c297" returned: 0 in 0.650s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-9b7a1363-c290-4571-b287-18c38165c297" released by "delete_volume" :: held 1.486s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Created reservations ['8b741703-5bf5-4688-a3a1-623c41ff1b9e', '228474bc-bde9-4ebd-95a6-e6aa06ceaec4', '4be89aa9-8ad4-47a2-ac97-f96bff158ddb', '580e9a09-f9b6-47b0-afd1-0abf6c613a87'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:37 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:37 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:37 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 1073741824" returned: 0 in 0.933s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:37 devstack sudo[111467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 Apr 30 11:21:37 devstack sudo[111467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-6a5ac785-1c93-4cdb-9220-c532512a42f6-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "cinder-6a5ac785-1c93-4cdb-9220-c532512a42f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29c152-f5b2-44d1-a80a-56e51fcf5bdf]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:37 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.745s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:37 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Deleted volume successfully. Apr 30 11:21:37 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-db49bfab-a8f2-4585-b0d0-066bfe836c26 tempest-VolumeDependencyTests-496657999 None] Lock "cinder-9b7a1363-c290-4571-b287-18c38165c297-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:38 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 Apr 30 11:21:38 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:38 devstack sudo[111467]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" returned: 0 in 0.794s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.739s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236795932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:20Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume 1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:38 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b3a88-c906-4b5a-a093-8bc01d71facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c 1073741824 Apr 30 11:21:38 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e380224b-6f66-4b9a-9f46-2a0372df19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 (eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88): created successfully Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e380224b-6f66-4b9a-9f46-2a0372df19cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (7e2c652a-8a69-47f2-93a5-7b5686e6fdef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Flow 'volume_create_manager' (03040f94-489c-4112-9858-3e2673454b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69aecaa-649d-4826-98c0-1f5e3fd76314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-4e661767-a88b-4acc-b62c-7c425402e925 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69aecaa-649d-4826-98c0-1f5e3fd76314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d9ab6-bca3-461c-8f3a-c2568a7c77cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626fc999de44c698740ed0703b31a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:38Z,use_quota=True,user_id='185aab614be744d4bae7f0f17452589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c9d1e0-83a1-42a2-bd96-c64aa5d6753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c9d1e0-83a1-42a2-bd96-c64aa5d6753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b93ba2d-7354-41d9-915f-875276c43eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b93ba2d-7354-41d9-915f-875276c43eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409d9ab6-bca3-461c-8f3a-c2568a7c77cd', 'volume_name': 'volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b8e55-3cb3-4c49-be65-7dbeee268fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b8e55-3cb3-4c49-be65-7dbeee268fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9734c208-06bd-4ee9-8501-4269e122e3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:38 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Volume 409d9ab6-bca3-461c-8f3a-c2568a7c77cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd', 'volume_size': 1} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:38 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6" returned: 0 in 0.761s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:38 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:38 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6 Apr 30 11:21:38 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:39 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c 1073741824" returned: 0 in 0.837s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:39 devstack sudo[111484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c Apr 30 11:21:39 devstack sudo[111484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:39 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-6a5ac785-1c93-4cdb-9220-c532512a42f6" returned: 0 in 0.686s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-6a5ac785-1c93-4cdb-9220-c532512a42f6" released by "delete_volume" :: held 1.517s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Created reservations ['0a29bf21-bff4-4378-a0b2-63e5a6c26e68', '04c4eb20-695d-4bcd-a0ca-b7a125cfdcf7', 'f7ca28e6-42c7-40c0-b53e-ab1c99131fa4', '04c56b77-b237-44b0-b752-57873b317d5f'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:39 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:39 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:39 devstack sudo[111484]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" returned: 0 in 0.653s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.814s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607102199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcf8cb7-7c63-4138-851a-e1e5a83b2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:21Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume bfcf8cb7-7c63-4138-851a-e1e5a83b2614 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:39 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:39 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 1073741824 Apr 30 11:21:39 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aa77e7-5ca2-40c9-906a-75794eaf915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c916dc-7c43-427f-add0-a849240ecbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:39 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c (1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c): created successfully Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c916dc-7c43-427f-add0-a849240ecbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:39 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (5265d99a-31c2-4d08-8173-0a5e3ecb9825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:39 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-af28a5dd-25a9-49a7-90cf-40bd057455b5 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-95e4540a-6d86-421b-9edb-7c66861e43dd-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "cinder-95e4540a-6d86-421b-9edb-7c66861e43dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Acquiring lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:40 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba74875-0d10-432d-8ddc-6b58241e118c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.703s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:40 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Deleted volume successfully. Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-87af8942-60f0-4ca0-923c-6805c660aacd tempest-VolumeDependencyTests-496657999 None] Lock "cinder-6a5ac785-1c93-4cdb-9220-c532512a42f6-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:40 devstack sudo[111494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd Apr 30 11:21:40 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:40 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 1073741824" returned: 0 in 0.836s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:40 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 Apr 30 11:21:40 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:40 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:40 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:40 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd Apr 30 11:21:40 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:41 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" returned: 0 in 0.612s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.598s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121889653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744afdb-756d-4eb0-8f04-092be5a79618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a114b8d4f4c425e96f7d2e816e2e74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:21Z,use_quota=True,user_id='6a209cc3875143cbbad322acc2e15b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Creating volume 2744afdb-756d-4eb0-8f04-092be5a79618 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:41 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6b33c3-7c4e-47b4-b7a4-f842025af1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68e5215-bd03-4c35-a176-7de495787a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:41 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 1073741824 Apr 30 11:21:41 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:41 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 (bfcf8cb7-7c63-4138-851a-e1e5a83b2614): created successfully Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68e5215-bd03-4c35-a176-7de495787a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (e1468026-c47d-4543-8e8b-0fadcd80cb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:41 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3a8295e7-d122-4c8c-a06f-d28c3dd37363 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:41 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-95e4540a-6d86-421b-9edb-7c66861e43dd" returned: 0 in 0.645s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "cinder-quobyte-95e4540a-6d86-421b-9edb-7c66861e43dd" released by "delete_volume" :: held 1.450s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Created reservations ['13010d84-f3b0-45f2-bd31-f8a83c8c21c3', '1ba7067f-770f-4beb-9ee7-eeb96902ce90', 'c1d92367-27da-4e3e-9be8-9a9fd8c716be', '2e21cb83-c139-462e-85bf-6500d40ace00'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:41 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:41 devstack sudo[111510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:41 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:42 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 1073741824" returned: 0 in 0.813s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:42 devstack sudo[111515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 Apr 30 11:21:42 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:42 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.613s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Deleted volume successfully. Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-296a6d33-db7e-45cb-8732-b34d23ddf84b tempest-VolumeDependencyTests-496657999 None] Lock "cinder-95e4540a-6d86-421b-9edb-7c66861e43dd-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:42 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618" returned: 0 in 0.654s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.658s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2044210228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbbc541-2dbf-4e98-ba28-933dfde54f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9535a45f53e3461a83fb088fb1212dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:23Z,use_quota=True,user_id='b61d87c51f984fecbbb1fe1e33299ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Creating volume 8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:42 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:42 devstack sudo[111519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 1073741824 Apr 30 11:21:42 devstack sudo[111519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983a29e1-9dd5-428b-a8ed-2a2e260ea43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2744afdb-756d-4eb0-8f04-092be5a79618', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64360dae-cd0a-4f79-9caf-f21e43724d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:42 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Volume volume-2744afdb-756d-4eb0-8f04-092be5a79618 (2744afdb-756d-4eb0-8f04-092be5a79618): created successfully Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64360dae-cd0a-4f79-9caf-f21e43724d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:42 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Flow 'volume_create_manager' (d10eeedc-9642-40ba-88b9-f9e7f86fac00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:42 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ef8cb531-617b-4165-a94b-935a79b7df61 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created volume successfully. Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-2744afdb-756d-4eb0-8f04-092be5a79618-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-2744afdb-756d-4eb0-8f04-092be5a79618-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-2744afdb-756d-4eb0-8f04-092be5a79618" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-2744afdb-756d-4eb0-8f04-092be5a79618" acquired by "delete_volume" :: waited 0.018s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6982f-fe16-4eb5-aa14-cf8f6c44432b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:43 devstack sudo[111519]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 1073741824" returned: 0 in 0.980s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:43 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:43 devstack sudo[111525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:21:43 devstack sudo[111525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:43 devstack sudo[111524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 Apr 30 11:21:43 devstack sudo[111524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:44 devstack sudo[111525]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.694s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.123s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d9ab6-bca3-461c-8f3a-c2568a7c77cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626fc999de44c698740ed0703b31a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:38Z,use_quota=True,user_id='185aab614be744d4bae7f0f17452589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Creating volume 409d9ab6-bca3-461c-8f3a-c2568a7c77cd {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:44 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087377c2-8294-4d5e-b888-c109971027e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:44 devstack sudo[111532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd 1073741824 Apr 30 11:21:44 devstack sudo[111532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:44 devstack sudo[111524]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7841d928-ddc3-4b67-a8da-e8d6b65a52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618" returned: 0 in 0.847s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:44 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Volume volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 (8fbbc541-2dbf-4e98-ba28-933dfde54f64): created successfully Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7841d928-ddc3-4b67-a8da-e8d6b65a52af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:44 devstack sudo[111534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618 Apr 30 11:21:44 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:44 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Flow 'volume_create_manager' (1cbca6a5-0847-4f07-b39a-bd5f4b0ebed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:44 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e15c79a6-f653-48be-a302-cdc3decd0794 tempest-SnapshotDependencyTests-1696689803 None] Created volume successfully. Apr 30 11:21:45 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-2744afdb-756d-4eb0-8f04-092be5a79618" returned: 0 in 0.663s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-2744afdb-756d-4eb0-8f04-092be5a79618" released by "delete_volume" :: held 1.555s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['e0d97fc4-f12f-40d9-8242-528e4635dda6', 'c9da664c-d682-4f99-9b85-05dbac325037', 'ec814420-b02a-4db3-8c3d-b9fcca55f52b', 'ea92f9fe-afa4-4eea-9dba-986aaa022b32'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:45 devstack sudo[111532]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd 1073741824" returned: 0 in 0.878s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:45 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:45 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:45 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd Apr 30 11:21:45 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-bfcf8cb7-7c63-4138-851a-e1e5a83b2614-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:45 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-bfcf8cb7-7c63-4138-851a-e1e5a83b2614-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" acquired by "delete_volume" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff1f34d-e006-426b-8f56-3bb11c1babf9]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:46 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" returned: 0 in 0.709s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.076s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:46 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.781s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9734c208-06bd-4ee9-8501-4269e122e3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470b097-7664-49ef-8760-cd98c33cc8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Creating offline snapshot 97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef of volume 8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:21:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb673406-2b84-412b-aaf6-8be6e235207e]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:46 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Volume volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd (409d9ab6-bca3-461c-8f3a-c2568a7c77cd): created successfully Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470b097-7664-49ef-8760-cd98c33cc8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Flow 'volume_create_manager' (03040f94-489c-4112-9858-3e2673454b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:46 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 Apr 30 11:21:46 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-6fd46b2f-5c15-437a-8606-c22ac065bb95 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-2744afdb-756d-4eb0-8f04-092be5a79618-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:46 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-02edc4ae-e939-4f87-8fab-051d43c398a7 tempest-CinderUnicodeTest-792031216 None] Created volume successfully. Apr 30 11:21:46 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:21:46 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:46 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" returned: 0 in 0.764s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:46 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:46 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614 Apr 30 11:21:46 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:47 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.824s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:47 devstack sudo[111559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef 1G Apr 30 11:21:47 devstack sudo[111559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Flow 'volume_create_manager' (41c54360-8325-4b99-a8d9-c6a41e532605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8810fa-507c-47d0-a8ec-7be9f472780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8810fa-507c-47d0-a8ec-7be9f472780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1504063098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df732865-1bad-4726-ab09-8cdfa564d611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626fc999de44c698740ed0703b31a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:47Z,use_quota=True,user_id='185aab614be744d4bae7f0f17452589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079bfbfe-aef4-4642-b243-63455a081b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079bfbfe-aef4-4642-b243-63455a081b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f388a0b4-90d5-4b48-ab17-def2131d714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f388a0b4-90d5-4b48-ab17-def2131d714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df732865-1bad-4726-ab09-8cdfa564d611', 'volume_name': 'volume-df732865-1bad-4726-ab09-8cdfa564d611', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe950b2-9251-4be6-9680-3043aa264b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe950b2-9251-4be6-9680-3043aa264b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8911a5-57fe-4d61-9457-9c2c1a98a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:47 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Volume df732865-1bad-4726-ab09-8cdfa564d611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df732865-1bad-4726-ab09-8cdfa564d611', 'volume_size': 1} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:47 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" returned: 0 in 0.623s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-bfcf8cb7-7c63-4138-851a-e1e5a83b2614" released by "delete_volume" :: held 1.443s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['8f38eee2-3804-4c7e-950d-064c90a37147', '484acfee-bfb1-4951-ab15-9db2dd6e532c', '72b960b3-b82a-4937-af4d-45424d258da5', 'd4510289-a6fd-4de7-a103-80455da6deb0'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:47 devstack sudo[111565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:47 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:47 devstack sudo[111559]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef 1G" returned: 0 in 0.815s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:47 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:47 devstack sudo[111568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:21:47 devstack sudo[111568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:48 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.628s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:48 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-f1c5d64a-416b-4675-a9db-61f7b7941704 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-bfcf8cb7-7c63-4138-851a-e1e5a83b2614-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cf29e-e282-4a47-9da6-db5f7b044ccb]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:48 devstack sudo[111571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c Apr 30 11:21:48 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:48 devstack sudo[111568]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.709s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:48 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef is being set with open permissions: ugo+rw Apr 30 11:21:48 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:48 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:21:48 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:49 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" returned: 0 in 0.756s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:49 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:49 devstack sudo[111582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c Apr 30 11:21:49 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.596s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:49 devstack sudo[111584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info Apr 30 11:21:49 devstack sudo[111584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:49 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" returned: 0 in 0.589s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c" released by "delete_volume" :: held 1.400s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['8eb9f1de-ee59-48f8-ab96-cb3ed79c458b', '5405410c-9ffd-42ec-9619-75b36c25bad2', '1c0ac8e0-1845-45ef-a534-85b90544d7a4', '8427390d-0701-474c-ae32-3f853edc4f9a'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:49 devstack sudo[111584]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info" returned: 0 in 0.678s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:49 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info is being set with open permissions: ugo+rw Apr 30 11:21:49 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:49 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:49 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:49 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info Apr 30 11:21:49 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:50 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.584s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:50 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.info" returned: 0 in 0.582s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.333s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1504063098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df732865-1bad-4726-ab09-8cdfa564d611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626fc999de44c698740ed0703b31a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:47Z,use_quota=True,user_id='185aab614be744d4bae7f0f17452589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Creating volume df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:50 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:50 devstack sudo[111595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 1073741824 Apr 30 11:21:50 devstack sudo[111595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-bcdf2cdc-3bd2-419e-bc65-256bf52c9dab tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-1cd7ccaf-e49b-473c-b1f5-f0cecf26f68c-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:50 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-7e44f2c3-7462-4589-af04-dbf35e890369 tempest-SnapshotDependencyTests-1696689803 None] Create snapshot completed successfully Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" acquired by "delete_volume" :: waited 0.014s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e673e0f-dc6b-447c-90ab-27b022f32610]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:50 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:50 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 Apr 30 11:21:50 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:51 devstack sudo[111595]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 1073741824" returned: 0 in 0.791s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:51 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 Apr 30 11:21:51 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:51 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" returned: 0 in 0.775s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:51 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88 Apr 30 11:21:51 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Flow 'volume_create_manager' (f5d50364-ce02-4793-9692-fee39d7fab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fab7aa-9cd8-4336-a2de-bb6dc9eb176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fab7aa-9cd8-4336-a2de-bb6dc9eb176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c9ee2c-a663-4080-a479-9f02c5261395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9535a45f53e3461a83fb088fb1212dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:21:52Z,use_quota=True,user_id='b61d87c51f984fecbbb1fe1e33299ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef59a05-4712-4ea0-a15a-e2d1de38b279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef59a05-4712-4ea0-a15a-e2d1de38b279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3505f5-a141-4bf4-89c3-7d81f30765e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3505f5-a141-4bf4-89c3-7d81f30765e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02c9ee2c-a663-4080-a479-9f02c5261395', 'volume_name': 'volume-02c9ee2c-a663-4080-a479-9f02c5261395', 'volume_size': 1, 'snapshot_id': '97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174e4677-f30c-4833-b66d-4a2fa405b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174e4677-f30c-4833-b66d-4a2fa405b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c733ffb5-96f5-4b30-8155-7775a9a44091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:51 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Volume 02c9ee2c-a663-4080-a479-9f02c5261395: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02c9ee2c-a663-4080-a479-9f02c5261395', 'volume_size': 1, 'snapshot_id': '97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef'} Apr 30 11:21:51 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:52 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611" returned: 0 in 0.650s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.114s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-02c9ee2c-a663-4080-a479-9f02c5261395" by "_create_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8911a5-57fe-4d61-9457-9c2c1a98a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df732865-1bad-4726-ab09-8cdfa564d611', 'volume_size': 1}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca13956e-d925-48c4-a787-83bd05958799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-02c9ee2c-a663-4080-a479-9f02c5261395" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Creating volume 02c9ee2c-a663-4080-a479-9f02c5261395 from snapshot 97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" by "_copy_volume_from_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:52 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Volume volume-df732865-1bad-4726-ab09-8cdfa564d611 (df732865-1bad-4726-ab09-8cdfa564d611): created successfully Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca13956e-d925-48c4-a787-83bd05958799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Flow 'volume_create_manager' (41c54360-8325-4b99-a8d9-c6a41e532605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] snapshot: 97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef, volume: 02c9ee2c-a663-4080-a479-9f02c5261395, {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:52 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-9cc540c7-7b76-4ce8-a3c4-ea0aea0dbe82 tempest-CinderUnicodeTest-792031216 None] Created volume successfully. Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219a9a5-845e-4c20-9b9f-3e0a5e5bdd3c]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:52 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" returned: 0 in 0.759s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88" released by "delete_volume" :: held 1.577s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:52 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:21:52 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['b6f205a0-1571-4ec0-820f-25d2566b5b31', 'c11e6f7f-3aed-468c-846d-e7807758c8f7', '7757e01d-d545-4f60-94c8-53ce0eab889c', '2aa99cd3-3fa6-4906-9ae1-e401e1378527'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:52 devstack sudo[111613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:52 devstack sudo[111613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-309d30c4-7bf9-462e-89cf-118515edafef-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-309d30c4-7bf9-462e-89cf-118515edafef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-309d30c4-7bf9-462e-89cf-118515edafef" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:52 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.752s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Creating direct copy from snapshot {{(pid=84432) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[741105ce-0803-4353-856b-8e5dc57ec27a]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-309d30c4-7bf9-462e-89cf-118515edafef" acquired by "delete_volume" :: waited 0.046s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a64c0-5ea0-4122-9345-e69244b02bf5]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:52 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:53 devstack sudo[111618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:21:53 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:53 devstack sudo[111619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef Apr 30 11:21:53 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:53 devstack sudo[111613]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.774s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:53 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-849652a3-acb7-438f-b865-947fb46ba89c tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-eeff6b45-7c6c-4ba9-81c3-2a1cde6f0e88-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:53 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.767s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG cinder.utils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Path /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 not found in is_blk_device check {{(pid=84432) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:53 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef" returned: 0 in 0.749s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:53 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:53 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 Apr 30 11:21:53 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:53 devstack sudo[111631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef Apr 30 11:21:53 devstack sudo[111631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:54 devstack sudo[111631]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-309d30c4-7bf9-462e-89cf-118515edafef" returned: 0 in 0.664s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-309d30c4-7bf9-462e-89cf-118515edafef" released by "delete_volume" :: held 1.460s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['771a3bcd-cb49-485b-a883-2813dea148ff', 'e73d8376-8c27-4004-a116-7141b5492978', 'ed17d06f-af81-493b-80ac-1360abb528d6', 'a1196a16-a9bb-42ec-962a-e56d550fefff'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:54 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:54 devstack sudo[111645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:54 devstack sudo[111645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-dd2ef4fb-791c-4a78-b238-b10bd0373a22-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-dd2ef4fb-791c-4a78-b238-b10bd0373a22-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "cinder-quobyte-dd2ef4fb-791c-4a78-b238-b10bd0373a22" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-dd2ef4fb-791c-4a78-b238-b10bd0373a22" acquired by "delete_volume" :: waited 0.044s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68963a5-9310-461a-b7a2-2ce70378080d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:55 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:55 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 Apr 30 11:21:55 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:56 devstack sudo[111645]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 1.513s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:56 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:56 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:56 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-90b8318f-7f73-427b-b9ba-11e990a2d6e9 tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-309d30c4-7bf9-462e-89cf-118515edafef-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:56 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22" returned: 0 in 1.426s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:56 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:57 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22 Apr 30 11:21:57 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:58 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-dd2ef4fb-791c-4a78-b238-b10bd0373a22" returned: 0 in 1.136s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-quobyte-dd2ef4fb-791c-4a78-b238-b10bd0373a22" released by "delete_volume" :: held 2.666s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Created reservations ['6e78dfcc-fa1f-40c6-91de-7ecd7101534b', '6e1f0f84-43c4-4a04-afa4-d8f60fd06346', 'c5723c0a-a457-477b-aa9b-f7f709718f30', '01a38051-1cd7-4ea9-85d4-c4be26ecb687'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:21:58 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:58 devstack sudo[111665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:21:58 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:59 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395" returned: 0 in 5.359s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0634c3-ca84-4852-b101-f0b4b83f54e8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:59 devstack sudo[111667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:21:59 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:21:59 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.978s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:21:59 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Deleted volume successfully. Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-e5ab5a52-2216-4541-8ba0-10f5c9469d8e tempest-CreateVolumesFromSourceVolumeTest-1628888517 None] Lock "cinder-dd2ef4fb-791c-4a78-b238-b10bd0373a22-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:21:59 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.889s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Image conversion details: src /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:21:59 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Converted 1024.00 MB image at 191.02 MB/s Apr 30 11:21:59 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 is being set with open permissions: ugo+rw Apr 30 11:21:59 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:21:59 devstack sudo[111674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 Apr 30 11:21:59 devstack sudo[111674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:00 devstack sudo[111674]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395" returned: 0 in 0.617s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" released by "_copy_volume_from_snapshot" :: held 8.497s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-02c9ee2c-a663-4080-a479-9f02c5261395" released by "_create_volume_from_snapshot" :: held 8.534s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.573s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.522s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Creating offline snapshot 9cf8c964-3494-4e27-8486-4a4f120ca0dc of volume df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c733ffb5-96f5-4b30-8155-7775a9a44091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c9ee2c-a663-4080-a479-9f02c5261395', 'volume_size': 1, 'snapshot_id': '97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef'}' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03fc03a-5d40-424f-9e74-c00b22df2877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca55d027-9c89-4b84-bda5-13907bbaae76]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:00 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Volume volume-02c9ee2c-a663-4080-a479-9f02c5261395 (02c9ee2c-a663-4080-a479-9f02c5261395): created successfully Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03fc03a-5d40-424f-9e74-c00b22df2877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:00 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Flow 'volume_create_manager' (f5d50364-ce02-4793-9692-fee39d7fab24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:22:00 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-94f48898-1a33-4a38-9190-068d7a0cdc7d tempest-SnapshotDependencyTests-1696689803 None] Created volume successfully. Apr 30 11:22:00 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 Apr 30 11:22:00 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:01 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611" returned: 0 in 0.790s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:01 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc 1G Apr 30 11:22:01 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:01 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" acquired by "_delete_snapshot" :: waited 0.089s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Deleting offline snapshot 97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef of volume 8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] snapshot_file for this snap is: volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c7075-bb80-46f2-9fce-b3015f070723]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:02 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:22:02 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:02 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc 1G" returned: 0 in 0.850s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df732865-1bad-4726-ab09-8cdfa564d611 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:02 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df732865-1bad-4726-ab09-8cdfa564d611 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc Apr 30 11:22:02 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:02 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.799s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d95bea-730c-4a79-acfe-25bb122e731d]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:02 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:03 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df732865-1bad-4726-ab09-8cdfa564d611 -F qcow2 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc" returned: 0 in 0.725s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:03 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc is being set with open permissions: ugo+rw Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:03 devstack sudo[111700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:22:03 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc Apr 30 11:22:03 devstack sudo[111700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:03 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:03 devstack sudo[111700]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.764s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:03 devstack sudo[111708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:22:03 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:03 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc" returned: 0 in 0.709s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:03 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:03 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info Apr 30 11:22:03 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:04 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.742s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:04 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info" returned: 0 in 0.676s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:04 devstack cinder-volume[84432]: WARNING cinder.volume.drivers.remotefs [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info is being set with open permissions: ugo+rw Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:04 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef Apr 30 11:22:04 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:04 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info Apr 30 11:22:04 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84432) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Flow 'volume_create_manager' (c2e58a82-c2de-4819-913c-09a46c3a8280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5d09b-616b-4508-8901-28bee2967f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5d09b-616b-4508-8901-28bee2967f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1d163f-233a-407a-a977-7c0888f175ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d06a1f6f2e401f9af5a43bdc108304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:22:04Z,use_quota=True,user_id='8bcbafd50fdd492f8dfb374e7f7a0a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad17e0-d028-40f4-a73d-c3200d81f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad17e0-d028-40f4-a73d-c3200d81f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62fbfd5-c837-4f19-8a53-b2b3ef1858aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.image.glance [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Creating Keystone auth plugin from conf {{(pid=84432) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62fbfd5-c837-4f19-8a53-b2b3ef1858aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a1d163f-233a-407a-a977-7c0888f175ab', 'volume_name': 'volume-7a1d163f-233a-407a-a977-7c0888f175ab', 'volume_size': 1, 'image_id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4709ceb2834f1c5aee80ad58e24b5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6d06a1f6f2e401f9af5a43bdc108304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd127de3a4d16acf288b76ae510d5b23963e8c0d0acb66f9f6a69733d6907ca2e8735cb919e26603e7b71279de9529193deb7f90236394c90a7548d16db47635', 'id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'created_at': datetime.datetime(2026, 4, 30, 9, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 22, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fb34b7-1ded-4c26-ade3-6a89d13e2bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fb34b7-1ded-4c26-ade3-6a89d13e2bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f5ec3e-17dc-4c3d-a508-084e79f1ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:04 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Volume 7a1d163f-233a-407a-a977-7c0888f175ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a1d163f-233a-407a-a977-7c0888f175ab', 'volume_size': 1, 'image_id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4709ceb2834f1c5aee80ad58e24b5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6d06a1f6f2e401f9af5a43bdc108304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd127de3a4d16acf288b76ae510d5b23963e8c0d0acb66f9f6a69733d6907ca2e8735cb919e26603e7b71279de9529193deb7f90236394c90a7548d16db47635', 'id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'created_at': datetime.datetime(2026, 4, 30, 9, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 22, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36/file', 'properties': {}}, 'image_service': } Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Trying to clone 7a1d163f-233a-407a-a977-7c0888f175ab from image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}]). {{(pid=84432) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:22:04 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Image download 0.00 MB at 0.00 MB/s Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ad4cd-d294-475a-a623-2e6ed10b8f25]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:04 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:05 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.info" returned: 0 in 0.629s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.520s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:05 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:05 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:05 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64.97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" returned: 0 in 0.689s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ab479b3d-4ca3-4cee-a6fc-2e81b5d51bbe tempest-CinderUnicodeTest-792031216 None] Create snapshot completed successfully Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef" released by "_delete_snapshot" :: held 3.156s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" released by "delete_snapshot" :: held 3.254s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Created reservations ['8757b89e-cdda-4f1b-a2c2-2604c3a19b15', 'be4a3805-7606-48b9-b8ba-01cb2802d683', '5bf7efe4-3912-4beb-8df0-25e3ff8a5757', '957c0b81-3efe-445b-9cb4-3593f9b65f1b'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:05 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Delete snapshot completed successfully. Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-70724c9c-57a8-46bf-99fb-1b0ddc471465 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-97f96b3a-ac00-4f3f-aaf7-10b05ff3bbef-delete_snapshot" released by "delete_snapshot" :: held 3.384s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:05 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-9cf8c964-3494-4e27-8486-4a4f120ca0dc-delete_snapshot" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:05 devstack sudo[111762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:05 devstack sudo[111762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-9cf8c964-3494-4e27-8486-4a4f120ca0dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" by "delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-quobyte-9cf8c964-3494-4e27-8486-4a4f120ca0dc" by "_delete_snapshot" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-9cf8c964-3494-4e27-8486-4a4f120ca0dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Deleting offline snapshot 9cf8c964-3494-4e27-8486-4a4f120ca0dc of volume df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] snapshot_file for this snap is: volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9abcecc-c59b-4015-b6bb-0d24a303c610]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:05 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:06 devstack sudo[111764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc Apr 30 11:22:06 devstack sudo[111764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_service.periodic_task [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84432) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:06 devstack sudo[111766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:06 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-8fbbc541-2dbf-4e98-ba28-933dfde54f64-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-8fbbc541-2dbf-4e98-ba28-933dfde54f64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" acquired by "delete_volume" :: waited 0.022s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ca32c-549e-4bb6-81ec-4142009069c1]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:06 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:22:06 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:06 devstack sudo[111762]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 1 in 0.808s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Temporary image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 is fetched for user 8bcbafd50fdd492f8dfb374e7f7a0a2d. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a063721-cdc6-404a-af56-0e3c127b8a83]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:06 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:06 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:06 devstack sudo[111764]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc" returned: 0 in 0.892s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df732865-1bad-4726-ab09-8cdfa564d611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84432) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[068fdd5c-3c07-4161-9a4e-5b1d0cedd0d8]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:06 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.792s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:06 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-098cca6f-a4b0-4725-882d-cf66486fe5ed None None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:07 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 Apr 30 11:22:07 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:07 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.831s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:07 devstack sudo[111785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64 Apr 30 11:22:07 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:07 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:07 devstack sudo[111789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:07 devstack sudo[111789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:07 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611" returned: 0 in 0.820s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:07 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc Apr 30 11:22:07 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:07 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-8fbbc541-2dbf-4e98-ba28-933dfde54f64" returned: 0 in 0.644s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-8fbbc541-2dbf-4e98-ba28-933dfde54f64" released by "delete_volume" :: held 1.551s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:07 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Created reservations ['51a8eede-3fba-4ec3-9212-a1b8d5985c40', 'fae6a36b-a31b-4c1a-8333-7fc113459a59', '199d0d05-3e97-4e3a-ab39-74b9434a581c', '3f7322bc-d68e-49b4-bc60-de510144ac3e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:08 devstack sudo[111797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:08 devstack sudo[111797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:08 devstack sudo[111789]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1d163f-233a-407a-a977-7c0888f175ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d06a1f6f2e401f9af5a43bdc108304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:22:04Z,use_quota=True,user_id='8bcbafd50fdd492f8dfb374e7f7a0a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c),volume_type_id=ebcdbb98-a3df-4ffa-aa59-2cac5a4ab01c)}" {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.remotefs [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Creating volume 7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Selected osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a as target Quobyte volume. {{(pid=84432) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:22:08 devstack cinder-volume[84432]: INFO cinder.volume.drivers.remotefs [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] casted to osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1073741824 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:08 devstack sudo[111802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1073741824 Apr 30 11:22:08 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:08 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc" returned: 0 in 0.753s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-02c9ee2c-a663-4080-a479-9f02c5261395-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:08 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc Apr 30 11:22:08 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-02c9ee2c-a663-4080-a479-9f02c5261395-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[490772b3-aa97-4330-abe2-f215bf999a6b]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:08 devstack sudo[111797]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.648s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:08 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Deleted volume successfully. Apr 30 11:22:08 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-04b20bcb-b06a-437c-81ad-f84823b1d876 tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-8fbbc541-2dbf-4e98-ba28-933dfde54f64-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:08 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 Apr 30 11:22:08 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:09 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1073741824" returned: 0 in 0.912s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:09 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:09 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:09 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611.9cf8c964-3494-4e27-8486-4a4f120ca0dc" returned: 0 in 0.777s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-9cf8c964-3494-4e27-8486-4a4f120ca0dc" released by "_delete_snapshot" :: held 3.367s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" released by "delete_snapshot" :: held 3.393s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Created reservations ['129b3608-e905-4df3-9c05-52a5840f2db5', 'acac995a-60c7-4b5c-b2ec-9367fe750e3e', '18f431b0-b316-4414-97cc-d4f813aaa5b9', 'ebd02bd8-f531-426e-b3b6-76c373947499'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:09 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Delete snapshot completed successfully. Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-b3561aa3-613b-45bc-8dfd-4dc402f71fc6 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-9cf8c964-3494-4e27-8486-4a4f120ca0dc-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:09 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395" returned: 0 in 0.820s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:09 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395 Apr 30 11:22:09 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:09 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 0 in 0.639s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'} {{(pid=84432) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Attempting download of e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 ((None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}])) to volume 7a1d163f-233a-407a-a977-7c0888f175ab. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c62dc2c-0033-4ffa-a8a0-ddfa72ba6b0f]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:09 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:09 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235 Apr 30 11:22:09 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:10 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-df732865-1bad-4726-ab09-8cdfa564d611-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-02c9ee2c-a663-4080-a479-9f02c5261395" returned: 0 in 0.658s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-quobyte-02c9ee2c-a663-4080-a479-9f02c5261395" released by "delete_volume" :: held 1.539s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-df732865-1bad-4726-ab09-8cdfa564d611-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" acquired by "delete_volume" :: waited 0.024s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Created reservations ['af1cd45d-3b08-4de0-8314-30af1b6c4193', '7a52804e-c3e5-4dc0-9647-56aea25e5b3d', '41b99114-2e34-49ac-b74e-5be5cb21cb69', 'a03aeb61-932d-4f8c-a39d-3a081e8ef523'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a3caa0-52be-40a6-9198-536030df3ae1]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:10 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 Apr 30 11:22:10 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:10 devstack sudo[111829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:10 devstack sudo[111829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:10 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235" returned: 0 in 0.762s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:10 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:10 devstack sudo[111834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235 Apr 30 11:22:10 devstack sudo[111834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:11 devstack sudo[111829]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:11 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611" returned: 0 in 0.785s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.701s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:11 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611 Apr 30 11:22:11 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:11 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Deleted volume successfully. Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-777adf93-9a46-414d-ad7e-685c9b27febc tempest-SnapshotDependencyTests-1696689803 None] Lock "cinder-02c9ee2c-a663-4080-a479-9f02c5261395-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:11 devstack sudo[111834]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235" returned: 1 in 0.710s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_yvojr235' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[69441903-5709-4eb5-af12-9f6c2a3090fc]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:11 devstack sudo[111844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:11 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:11 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-df732865-1bad-4726-ab09-8cdfa564d611" returned: 0 in 0.706s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-df732865-1bad-4726-ab09-8cdfa564d611" released by "delete_volume" :: held 1.565s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Created reservations ['b45bf562-f0a5-4833-8e99-83e7e9fec6e1', '7aebd017-4abf-4116-af36-d911c0360dc6', '9b5b7e5a-fe8f-4e93-9d2b-f361cbd1471b', '90db50b5-7647-4b60-b633-8bf69262745e'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:11 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:11 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:11 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:12 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:12 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD Apr 30 11:22:12 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-409d9ab6-bca3-461c-8f3a-c2568a7c77cd-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-409d9ab6-bca3-461c-8f3a-c2568a7c77cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "cinder-quobyte-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a85cc6-f22e-4d03-ba7c-5cfa90e765a3]: (4, 'qcow2') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:12 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.707s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:12 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Deleted volume successfully. Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-ab20703c-3c3b-46e1-95a5-4a1a2c9e56c2 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-df732865-1bad-4726-ab09-8cdfa564d611-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:12 devstack sudo[111856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd Apr 30 11:22:12 devstack sudo[111856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:12 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 was raw, converting to raw {{(pid=84432) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:22:12 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:12 devstack sudo[111861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:12 devstack sudo[111861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:13 devstack sudo[111856]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" returned: 0 in 0.808s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:13 devstack sudo[111866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd Apr 30 11:22:13 devstack sudo[111866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:13 devstack sudo[111861]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 0 in 0.797s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:13 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e18b2bdd-1386-4f41-8b4c-3bd5310b4e36_50yno9jldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:22:13 devstack cinder-volume[84432]: INFO cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Converted 0.00 MB image at 0.00 MB/s Apr 30 11:22:13 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1G {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:13 devstack sudo[111871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1G Apr 30 11:22:13 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:14 devstack sudo[111866]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" returned: 0 in 0.747s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-quobyte-409d9ab6-bca3-461c-8f3a-c2568a7c77cd" released by "delete_volume" :: held 1.624s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Created reservations ['06a57bdd-8e83-49e0-bb47-202689084c81', '7cf4c51d-59f6-4616-804b-3fd4305063b0', '3d893a8c-8c21-461b-abe3-398a15cb9c07', 'cbee25e4-6a47-4c39-ac02-d8b8c876557d'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:14 devstack sudo[111878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:14 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:14 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab 1G" returned: 0 in 0.691s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d193b-7ec1-4792-8926-935fd45b8683]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:14 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:14 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:14 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:15 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.789s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:15 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:15 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Deleted volume successfully. Apr 30 11:22:15 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-3dc1cc61-ba47-429a-9453-f3140d5697a3 tempest-CinderUnicodeTest-792031216 None] Lock "cinder-409d9ab6-bca3-461c-8f3a-c2568a7c77cd-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:15 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 0 in 0.925s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:15 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:15 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:15 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:16 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 1 in 0.808s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Downloaded image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 ((None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}])) to volume 7a1d163f-233a-407a-a977-7c0888f175ab successfully. {{(pid=84432) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.image.image_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Temporary image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 for user 8bcbafd50fdd492f8dfb374e7f7a0a2d is deleted. {{(pid=84432) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.volume_utils [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Marking volume 7a1d163f-233a-407a-a977-7c0888f175ab as bootable. {{(pid=84432) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Copying metadata from image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 to 7a1d163f-233a-407a-a977-7c0888f175ab. {{(pid=84432) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Creating volume glance metadata for volume 7a1d163f-233a-407a-a977-7c0888f175ab backed by image e18b2bdd-1386-4f41-8b4c-3bd5310b4e36 with: {'image_id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ce4709ceb2834f1c5aee80ad58e24b5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84432) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f5ec3e-17dc-4c3d-a508-084e79f1ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1d163f-233a-407a-a977-7c0888f175ab', 'volume_size': 1, 'image_id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce4709ceb2834f1c5aee80ad58e24b5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6d06a1f6f2e401f9af5a43bdc108304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd127de3a4d16acf288b76ae510d5b23963e8c0d0acb66f9f6a69733d6907ca2e8735cb919e26603e7b71279de9529193deb7f90236394c90a7548d16db47635', 'id': 'e18b2bdd-1386-4f41-8b4c-3bd5310b4e36', 'created_at': datetime.datetime(2026, 4, 30, 9, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 22, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18b2bdd-1386-4f41-8b4c-3bd5310b4e36/file', 'properties': {}}, 'image_service': }' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496f4d9d-05ff-4860-8fc7-5ac757490671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:22:16 devstack cinder-volume[84432]: INFO cinder.volume.flows.manager.create_volume [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Volume volume-7a1d163f-233a-407a-a977-7c0888f175ab (7a1d163f-233a-407a-a977-7c0888f175ab): created successfully Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496f4d9d-05ff-4860-8fc7-5ac757490671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84432) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Flow 'volume_create_manager' (c2e58a82-c2de-4819-913c-09a46c3a8280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84432) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:22:16 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-dd6ee478-1adf-47fc-9eaf-aa1b9d1767f2 tempest-VolumeImageDependencyTests-1817999352 None] Created volume successfully. Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Acquiring lock "cinder-7a1d163f-233a-407a-a977-7c0888f175ab-delete_volume" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "cinder-7a1d163f-233a-407a-a977-7c0888f175ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Acquiring lock "cinder-quobyte-7a1d163f-233a-407a-a977-7c0888f175ab" by "delete_volume" {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "cinder-quobyte-7a1d163f-233a-407a-a977-7c0888f175ab" acquired by "delete_volume" :: waited 0.020s {{(pid=84432) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG oslo.privsep.daemon [-] privsep: reply[778ffb3e-2251-41e0-8149-5e86fade005c]: (4, 'raw') {{(pid=84601) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:22:16 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:16 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:16 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:17 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 0 in 0.725s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:17 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:17 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:17 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:18 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 1 in 0.768s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab' failed. Not Retrying. {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:18 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab Apr 30 11:22:18 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:18 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57/volume-7a1d163f-233a-407a-a977-7c0888f175ab" returned: 0 in 0.668s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "cinder-quobyte-7a1d163f-233a-407a-a977-7c0888f175ab" released by "delete_volume" :: held 2.234s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG cinder.quota [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Created reservations ['bd2a8c92-b425-4758-813b-55538d2bb04a', '578b8ab1-b0f4-4474-832d-6378a70b408b', '01131d3c-e662-4a45-9ed9-bb1a35755fb8', 'dc91f903-090b-4d38-bd96-cafc4cebb539'] {{(pid=84432) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a': None} {{(pid=84432) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG cinder.volume.drivers.quobyte [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8da72eeb-3851-45f6-95e3-df88b1bacf8a'] {{(pid=84432) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.lockutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84432) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:22:18 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:22:18 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57 Apr 30 11:22:18 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:22:19 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Apr 30 11:22:19 devstack cinder-volume[84432]: DEBUG oslo_concurrency.processutils [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7736aa5d7877ec5be39127bf8e075f57" returned: 0 in 0.641s {{(pid=84432) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:22:19 devstack cinder-volume[84432]: DEBUG cinder.manager [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Notifying Schedulers of capabilities ... {{(pid=84432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:22:19 devstack cinder-volume[84432]: INFO cinder.volume.manager [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Deleted volume successfully. Apr 30 11:22:19 devstack cinder-volume[84432]: DEBUG cinder.coordination [None req-5c8feab1-0972-4ac1-9367-f4323f0f858b tempest-VolumeImageDependencyTests-1817999352 None] Lock "cinder-7a1d163f-233a-407a-a977-7c0888f175ab-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=84432) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:22:28 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=121,cinder:INSERT=50,cinder:UPDATE=175,cinder:DELETE=12 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:22:29 devstack cinder-volume[84432]: DEBUG dbcounter [-] [84432] Writing DB stats cinder:SELECT=117,cinder:INSERT=43,cinder:UPDATE=165,cinder:DELETE=16 {{(pid=84432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}